Jul 07 17:52:52 devstack cinder-volume[75547]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:52:52 devstack cinder-volume[75547]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:52:52 devstack cinder-volume[75547]: we strongly recommend against using it for new projects. Jul 07 17:52:52 devstack cinder-volume[75547]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:52:52 devstack cinder-volume[75547]: framework. For more detail see Jul 07 17:52:52 devstack cinder-volume[75547]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:52:52 devstack cinder-volume[75547]: import eventlet # noqa Jul 07 17:52:55 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:52:55 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:52:55 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:52:56 devstack cinder-volume[75547]: INFO dbcounter [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Registered counter for database cinder Jul 07 17:52:56 devstack cinder-volume[75547]: DEBUG oslo_db.sqlalchemy.engines [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:52:56 devstack cinder-volume[75547]: DEBUG dbcounter [-] [75547] Writer thread running {{(pid=75547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:52:56 devstack cinder-volume[75547]: INFO cinder.rpc [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:52:56 devstack cinder-volume[75547]: INFO cinder.rpc [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:52:56 devstack cinder-volume[75547]: DEBUG oslo_db.sqlalchemy.engines [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:52:56 devstack cinder-volume[75547]: INFO cinder.volume.manager [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Determined volume DB was empty at startup. Jul 07 17:52:56 devstack cinder-volume[75547]: DEBUG cinder.volume.manager [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75547) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:52:56 devstack cinder-volume[75547]: INFO cinder.volume.manager [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:52:56 devstack cinder-volume[75547]: WARNING stevedore.named [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:52:56 devstack cinder-volume[75547]: WARNING castellan.key_manager [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:52:56 devstack cinder-volume[75547]: WARNING cinder.keymgr.conf_key_mgr [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG cinder.volume.drivers.lvm [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75547) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_concurrency.processutils [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_concurrency.processutils [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.381s {{(pid=75547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_db.sqlalchemy.engines [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:52:57 devstack cinder-volume[75547]: INFO cinder.rpc [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 17:52:57 devstack cinder-volume[75547]: INFO cinder.rpc [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 17:52:57 devstack cinder-volume[75547]: WARNING stevedore.named [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:52:57 devstack cinder-volume[75547]: WARNING castellan.key_manager [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:52:57 devstack cinder-volume[75547]: INFO cinder.volume.manager [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_db.sqlalchemy.engines [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:52:57 devstack cinder-volume[75547]: INFO oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Starting 1 workers Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Started child 75720 {{(pid=75547) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Full set of CONF: {{(pid=75547) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] ******************************************************************************** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Configuration options gathered from: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:52:57 devstack cinder-volume[75720]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] ================================================================================ {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] allow_availability_zone_fallback = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] allow_compression_on_image_upload = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] allowed_direct_url_schemes = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] api_rate_limit = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] auth_strategy = keystone {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] az_cache_duration = 3600 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_availability_zone = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_host = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_stats_polling_interval = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backup_api_class = cinder.backup.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backup_name_template = backup-%s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backup_use_same_host = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backup_use_temp_snapshot = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] chap_password = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] chap_username = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cinder_internal_tenant_project_id = 60a26170f39d4132ab7322594e71888c {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cinder_internal_tenant_user_id = dde7680f178e4363b29ed0441ed6817c {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cloned_volume_same_az = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cluster = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] compression_format = gzip {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] compute_api_class = cinder.compute.nova.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] config_dir = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] config_source = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] control_exchange = openstack {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] debug = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] default_availability_zone = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] default_group_type = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] default_volume_type = lvmdriver-1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] disk_geometry = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] driver_client_cert = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] driver_client_cert_key = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] driver_data_namespace = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] driver_ssl_cert_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] driver_ssl_cert_verify = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] driver_use_ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] enable_force_upload = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] enable_new_services = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] enable_unsupported_driver = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] enforce_multipath_for_image_xfer = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] filter_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_api_insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_api_ssl_compression = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_ca_certificates_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_catalog_info = image:glance:publicURL {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75720]: INFO cinder.volume.manager [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 17:52:57 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_num_retries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance_request_timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] goodness_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] graceful_shutdown_timeout = 5 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] group_api_class = cinder.group.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] host = devstack {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_compress_on_upload = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_conversion_address_space_limit = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_conversion_cpu_limit = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_conversion_disable = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_upload_use_cinder_backend = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_upload_use_internal_tenant = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_volume_cache_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_volume_cache_max_count = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] image_volume_cache_max_size_gb = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] init_host_max_objects_retrieval = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] instance_format = [instance: %(uuid)s] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] iscsi_target_flags = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] iscsi_write_cache = on {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] iser_helper = tgtadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] iser_ip_address = 192.168.122.148 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] iser_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] log_color = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] log_config_append = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] log_dir = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] log_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] log_options = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] log_rotate_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] log_rotate_interval_type = days {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] log_rotation_type = none {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] max_age = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] max_logfile_count = 30 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] max_logfile_size_mb = 200 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] max_over_subscription_ratio = 20.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] message_reap_interval = 86400 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] message_ttl = 2592000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] migration_create_volume_timeout_secs = 300 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] monkey_patch = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] monkey_patch_modules = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] my_ip = 192.168.122.148 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] no_snapshot_gb_quota = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] num_iser_scan_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] num_shell_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] num_volume_device_scan_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] nvmeof_conn_info_version = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] nvmet_ns_id = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] nvmet_port_id = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] osapi_max_limit = 1000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] osapi_volume_ext_list = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] osapi_volume_listen_port = 8776 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:57 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] osapi_volume_use_ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] osapi_volume_workers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] per_volume_size_limit = -1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack sudo[75724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 17:52:58 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:58 devstack sudo[75724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] periodic_fuzzy_delay = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] periodic_interval = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] public_endpoint = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] publish_errors = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] quota_backup_gigabytes = 1000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] quota_backups = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] quota_gigabytes = 1000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] quota_groups = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] quota_snapshots = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] quota_volumes = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] rate_limit_burst = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] rate_limit_except_level = CRITICAL {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] rate_limit_interval = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] reinit_driver_count = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] replication_device = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] report_discard_supported = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] report_interval = 120 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] reservation_clean_interval = 86400 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] reservation_expire = 86400 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] reserved_image_namespaces = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] reserved_percentage = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] rpc_response_timeout = 120 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] run_external_periodic_tasks = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] scst_target_driver = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] scst_target_iqn_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_down_time = 720 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] shell_completion = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] snapshot_name_template = snapshot-%s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] snapshot_same_host = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] state_path = /opt/stack/data/cinder {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] storage_availability_zone = nova {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] storage_protocol = iSCSI {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] syslog_log_facility = LOG_USER {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] target_helper = lioadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] target_ip_address = 192.168.122.148 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] target_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] target_protocol = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] target_secondary_ip_addresses = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] trace_flags = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] transport_url = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] until_refresh = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] use_chap_auth = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] use_default_quota_class = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] use_journal = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] use_json = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] use_multipath_for_image_xfer = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] use_stderr = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] use_syslog = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] verify_glance_signatures = enabled {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_api_class = cinder.volume.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_backend_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_clear = zero {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_clear_ionice = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_clear_size = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_copy_bps_limit = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_dd_blocksize = 1M {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_name_template = volume-%s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_service_inithost_offload = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volume_usage_audit_period = month {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:58 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] zoning_mode = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_concurrency.disable_process_locking = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.auth_section = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.auth_type = password {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.auth_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.cache = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.include_service_catalog = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.interface = public {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_password = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcache_username = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.region_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.service_type = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.backend = dogpile.cache.null {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.backend_argument = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.backend_expiration_time = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.config_prefix = cache.oslo {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.debug_cache_backend = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.enable_retry_client = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.enable_socket_keepalive = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.expiration_time = 600 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.hashclient_retry_attempts = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.memcache_dead_retry = 300 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.memcache_pool_maxsize = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.memcache_sasl_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.password = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.proxies = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.redis_db = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.redis_server = localhost:6379 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.retry_attempts = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.retry_delay = 0.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.socket_keepalive_count = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.socket_keepalive_idle = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.socket_keepalive_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.socket_timeout = 1.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.tls_allowed_ciphers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.tls_cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.tls_certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.tls_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.tls_keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cache.username = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] coordination.backend_url = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.asyncio_connection = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.asyncio_slave_connection = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.backend = sqlalchemy {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.connection = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.connection_debug = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.connection_parameters = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.connection_recycle_time = 3600 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.connection_trace = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.db_inc_retry_interval = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.db_max_retries = 20 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.db_max_retry_interval = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.db_retry_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.max_overflow = 50 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.max_pool_size = 5 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.max_retries = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.mysql_wsrep_sync_wait = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.pool_timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.retry_interval = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.slave_connection = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.sqlite_synchronous = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.synchronous_reader = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] database.use_db_reconnect = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.connection_string = messaging:// {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.es_doc_type = notification {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.es_scroll_size = 10000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.es_scroll_time = 2m {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.filter_error_trace = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.hmac_keys = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.sentinel_service_name = mymaster {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.socket_timeout = 0.1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.trace_requests = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler.trace_sqlalchemy = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler_jaeger.process_tags = {} {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler_jaeger.service_name_prefix = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] profiler_otlp.service_name_prefix = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.enforce_new_defaults = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.enforce_scope = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.policy_default_rule = default {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.policy_file = policy.yaml {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] privsep_osbrick.group = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] privsep_osbrick.helper_command = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] privsep_osbrick.user = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cinder_sys_admin.group = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cinder_sys_admin.helper_command = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] cinder_sys_admin.user = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.auth_section = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.auth_type = password {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.collect_timing = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.send_service_user_token = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] service_user.timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.auth_section = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.auth_type = password {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.collect_timing = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.region_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] glance.timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.backend_availability_zone = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.chap_password = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.chap_username = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.disk_geometry = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.driver_client_cert = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.driver_client_cert_key = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.driver_data_namespace = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.driver_use_ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.extra_capabilities = {} {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.filter_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.goodness_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.iscsi_target_flags = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.iscsi_write_cache = on {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.iser_helper = tgtadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.iser_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.lvm_share_target = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.lvm_type = auto {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.num_shell_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.replication_device = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.report_discard_supported = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.reserved_percentage = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.target_helper = tgtadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.target_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.target_protocol = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.trace_flags = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.unique_fqdn_network = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.use_chap_auth = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volume_backend_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volume_clear = zero {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volume_clear_ionice = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volume_clear_size = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_reports.file_event_handler = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_reports.log_dir = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.backend_host = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.chap_password = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.chap_username = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.disk_geometry = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.driver_client_cert = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.extra_capabilities = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.filter_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.goodness_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.iser_helper = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.iser_ip_address = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.iser_port = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.lvm_share_target = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.lvm_type = auto {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.num_shell_tries = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.replication_device = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.report_discard_supported = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.reserved_percentage = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.scst_target_driver = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.storage_protocol = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.target_helper = lioadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.target_ip_address = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.target_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.trace_flags = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.use_chap_auth = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volume_clear = zero {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volume_clear_size = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] lvmdriver-1.volumes_dir = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_notifications.driver = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_notifications.retry = -1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] key_manager.fixed_key = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.barbican_api_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.barbican_endpoint = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.barbican_endpoint_type = public {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.barbican_region_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.collect_timing = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.number_of_retries = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.retry_delay = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.send_service_user_token = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.verify_ssl = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican.verify_ssl_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican_service_user.auth_section = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican_service_user.auth_type = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican_service_user.cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican_service_user.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican_service_user.collect_timing = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican_service_user.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican_service_user.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican_service_user.split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] barbican_service_user.timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.approle_role_id = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.approle_secret_id = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.kv_mountpoint = secret {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.kv_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.kv_version = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.namespace = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.root_token_id = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.ssl_ca_crt_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.timeout = 60.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.use_ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:52:58 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] ******************************************************************************** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:52:58 devstack sudo[75724]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:58 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.787s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:58 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:58 devstack sudo[75749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:52:58 devstack sudo[75749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:52:59 devstack sudo[75749]: pam_unix(sudo:session): session closed for user root Jul 07 17:52:59 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.632s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:59 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 17:52:59 devstack cinder-volume[75720]: INFO cinder.brick.local_dev.lvm [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 17:52:59 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:59 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:52:59 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:52:59 devstack sudo[75980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:52:59 devstack sudo[75980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:00 devstack sudo[75980]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:00 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:00 devstack cinder-volume[75720]: DEBUG cinder.brick.local_dev.lvm [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75720) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 17:53:00 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:00 devstack sudo[76193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:53:00 devstack sudo[76193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:01 devstack sudo[76193]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:01 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.672s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:01 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:01 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:01 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:01 devstack sudo[76490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:53:01 devstack sudo[76490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:02 devstack sudo[76490]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:02 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.766s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:02 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:02 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:02 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:02 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 17:53:02 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:03 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:03 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.747s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:03 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:03 devstack sudo[76509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:53:03 devstack sudo[76509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:04 devstack sudo[76509]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:04 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.778s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:04 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:04 devstack sudo[76520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:53:04 devstack sudo[76520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:04 devstack sudo[76520]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:04 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.779s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:04 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:04 devstack sudo[76524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:53:04 devstack sudo[76524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:05 devstack sudo[76524]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:05 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:05 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:05 devstack sudo[76529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:53:05 devstack sudo[76529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:06 devstack sudo[76529]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:06 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.760s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:06 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:06 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:06 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:06 devstack sudo[76535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:53:06 devstack sudo[76535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:07 devstack sudo[76535]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:07 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:07 devstack cinder-volume[75720]: INFO cinder.volume.drivers.lvm [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 17:53:07 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:07 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:07 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:07 devstack sudo[76550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:53:07 devstack sudo[76550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:07 devstack cinder-volume[75547]: DEBUG dbcounter [-] [75547] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:53:07 devstack sudo[76550]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:07 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.810s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:07 devstack cinder-volume[75720]: DEBUG cinder.volume.drivers.lvm [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Updating volume stats {{(pid=75720) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:53:07 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:07 devstack sudo[76700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:53:07 devstack sudo[76700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:08 devstack sudo[76700]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:08 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:08 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:08 devstack sudo[76706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:53:08 devstack sudo[76706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:09 devstack sudo[76706]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:09 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:09 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:09 devstack sudo[76709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:53:09 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:09 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:09 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.623s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:09 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:09 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:53:09 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:10 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:10 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:10 devstack cinder-volume[75720]: INFO cinder.volume.driver [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:53:10 devstack cinder-volume[75720]: DEBUG cinder.volume.driver [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75720) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:53:10 devstack cinder-volume[75720]: DEBUG oslo_db.sqlalchemy.engines [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75720) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:53:10 devstack cinder-volume[75720]: DEBUG dbcounter [-] [75720] Writer thread running {{(pid=75720) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:53:10 devstack cinder-volume[75720]: DEBUG cinder.db.api [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Building query based on filter {{(pid=75720) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:53:10 devstack cinder-volume[75720]: DEBUG cinder.image.image_utils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75720) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:53:10 devstack cinder-volume[75720]: INFO cinder.keymgr.migration [None req-5e514e7c-ff91-4566-bfdf-f6bd6932d03a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:53:10 devstack cinder-volume[75720]: DEBUG cinder.volume.drivers.lvm [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Updating volume stats {{(pid=75720) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:53:10 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:10 devstack sudo[76720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:53:10 devstack sudo[76720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:11 devstack sudo[76720]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:11 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:11 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:11 devstack sudo[76723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:53:11 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:11 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:11 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:11 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:11 devstack sudo[76727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:53:11 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:12 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:12 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:12 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:12 devstack sudo[76731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:53:12 devstack sudo[76731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:13 devstack sudo[76731]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:13 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:13 devstack cinder-volume[75720]: DEBUG cinder.manager [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Notifying Schedulers of capabilities ... {{(pid=75720) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:53:13 devstack cinder-volume[75720]: INFO cinder.volume.manager [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Driver initialization completed successfully. Jul 07 17:53:13 devstack cinder-volume[75720]: INFO cinder.manager [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Initiating service 2 cleanup Jul 07 17:53:13 devstack cinder-volume[75720]: INFO cinder.manager [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Service 2 cleanup completed. Jul 07 17:53:13 devstack cinder-volume[75720]: DEBUG cinder.service [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Creating RPC server for service cinder-volume {{(pid=75720) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:53:13 devstack cinder-volume[75720]: DEBUG cinder.service [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75720) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:53:13 devstack cinder-volume[75720]: INFO cinder.volume.manager [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 17:53:13 devstack cinder-volume[75720]: DEBUG cinder.volume.drivers.lvm [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Updating volume stats {{(pid=75720) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:53:13 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:13 devstack sudo[76734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:53:13 devstack sudo[76734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:13 devstack sudo[76734]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:13 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:13 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:13 devstack sudo[76737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:53:13 devstack sudo[76737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:14 devstack sudo[76737]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:14 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:14 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:14 devstack sudo[76743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:53:14 devstack sudo[76743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:15 devstack sudo[76743]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:15 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.672s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:15 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:53:15 devstack sudo[76746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:53:15 devstack sudo[76746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:53:15 devstack sudo[76746]: pam_unix(sudo:session): session closed for user root Jul 07 17:53:15 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:53:15 devstack cinder-volume[75720]: INFO cinder.volume.manager [None req-1f2bc6fe-b246-493f-a1af-64718dbbf817 None None] Driver post RPC initialization completed successfully. Jul 07 17:53:23 devstack cinder-volume[75720]: DEBUG dbcounter [-] [75720] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75720) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:53:25 devstack cinder-volume[75720]: DEBUG dbcounter [-] [75720] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75720) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:53:52 devstack cinder-volume[75720]: DEBUG oslo_service.periodic_task [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running periodic task VolumeManager._thread_info {{(pid=75720) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:53:52 devstack cinder-volume[75720]: DEBUG cinder.volume.manager [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] thread count: 6 {{(pid=75720) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:53:52 devstack cinder-volume[75720]: DEBUG cinder.volume.manager [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] thread info: [<_MainThread(MainThread, started 124647268302976)>, , , , , ] {{(pid=75720) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:54:52 devstack cinder-volume[75720]: DEBUG oslo_service.periodic_task [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75720) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:54:52 devstack cinder-volume[75720]: DEBUG cinder.volume.drivers.lvm [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Updating volume stats {{(pid=75720) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:54:52 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:52 devstack sudo[81807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:54:52 devstack sudo[81807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:53 devstack sudo[81807]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:53 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:53 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:53 devstack sudo[81810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:54:53 devstack sudo[81810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:54 devstack sudo[81810]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:54 devstack sudo[81813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:54:54 devstack sudo[81813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:54 devstack sudo[81813]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:54:54 devstack sudo[81816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:54:54 devstack sudo[81816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:54:55 devstack sudo[81816]: pam_unix(sudo:session): session closed for user root Jul 07 17:54:55 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:54:55 devstack cinder-volume[75720]: DEBUG cinder.manager [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Notifying Schedulers of capabilities ... {{(pid=75720) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:54:55 devstack cinder-volume[75720]: DEBUG oslo_service.periodic_task [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running periodic task VolumeManager._thread_info {{(pid=75720) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:54:55 devstack cinder-volume[75720]: DEBUG cinder.volume.manager [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] thread count: 6 {{(pid=75720) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:54:55 devstack cinder-volume[75720]: DEBUG cinder.volume.manager [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] thread info: [<_MainThread(MainThread, started 124647268302976)>, , , , , ] {{(pid=75720) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:55:25 devstack cinder-volume[75720]: DEBUG dbcounter [-] [75720] Writing DB stats cinder:SELECT=1 {{(pid=75720) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:55:25 devstack cinder-volume[75720]: DEBUG dbcounter [-] [75720] Writing DB stats cinder:UPDATE=1 {{(pid=75720) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:55:52 devstack cinder-volume[75720]: DEBUG oslo_service.periodic_task [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75720) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:55:52 devstack cinder-volume[75720]: DEBUG cinder.volume.drivers.lvm [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Updating volume stats {{(pid=75720) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:55:52 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:53 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:55:53 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:53 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:53 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:53 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:53 devstack sudo[83893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:55:53 devstack sudo[83893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:54 devstack sudo[83893]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:54 devstack sudo[83928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:55:54 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:55 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:55 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:55 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:55:55 devstack sudo[83964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:55:55 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:55:55 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root Jul 07 17:55:55 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:55:55 devstack cinder-volume[75720]: DEBUG cinder.manager [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Notifying Schedulers of capabilities ... {{(pid=75720) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:55:55 devstack cinder-volume[75720]: DEBUG oslo_service.periodic_task [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running periodic task VolumeManager._thread_info {{(pid=75720) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:55:55 devstack cinder-volume[75720]: DEBUG cinder.volume.manager [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] thread count: 6 {{(pid=75720) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:55:55 devstack cinder-volume[75720]: DEBUG cinder.volume.manager [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] thread info: [<_MainThread(MainThread, started 124647268302976)>, , , , , ] {{(pid=75720) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:56:52 devstack cinder-volume[75720]: DEBUG oslo_service.periodic_task [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75720) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:56:52 devstack cinder-volume[75720]: DEBUG cinder.volume.drivers.lvm [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Updating volume stats {{(pid=75720) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 17:56:52 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:53 devstack sudo[85303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 17:56:53 devstack sudo[85303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:53 devstack sudo[85303]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:53 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:53 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:53 devstack sudo[85309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:56:53 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:54 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:54 devstack sudo[85313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 17:56:54 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:54 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:54 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:56:54 devstack sudo[85328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 17:56:54 devstack sudo[85328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:56:55 devstack sudo[85328]: pam_unix(sudo:session): session closed for user root Jul 07 17:56:55 devstack cinder-volume[75720]: DEBUG oslo_concurrency.processutils [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75720) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:56:55 devstack cinder-volume[75720]: DEBUG cinder.manager [None req-a0dc941c-9fb4-4ba6-86bd-d5e256e2d0a5 None None] Notifying Schedulers of capabilities ... {{(pid=75720) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:25 devstack cinder-volume[75720]: DEBUG dbcounter [-] [75720] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75720) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:57:32 devstack cinder-volume[75547]: INFO oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Caught SIGTERM, stopping children Jul 07 17:57:32 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Acquiring lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:57:32 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Acquired lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:57:32 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Releasing lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:57:32 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Stop services. {{(pid=75547) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:57:32 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Killing children. {{(pid=75547) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:57:32 devstack cinder-volume[75547]: INFO oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Waiting on 1 children to exit Jul 07 17:57:33 devstack cinder-volume[75720]: DEBUG oslo_concurrency.lockutils [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Acquiring lock "singleton_lock" {{(pid=75720) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:57:33 devstack cinder-volume[75720]: DEBUG oslo_concurrency.lockutils [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Acquired lock "singleton_lock" {{(pid=75720) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:57:33 devstack cinder-volume[75720]: DEBUG oslo_concurrency.lockutils [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Releasing lock "singleton_lock" {{(pid=75720) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:57:33 devstack cinder-volume[75720]: WARNING amqp [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:57:33 devstack cinder-volume[75720]: WARNING amqp [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:57:33 devstack cinder-volume[75547]: INFO oslo_service.backend._eventlet.service [None req-ad6e37af-9536-4606-8400-ceb3de8ad3e9 None None] Child 75720 exited with status 0 Jul 07 17:57:33 devstack cinder-volume[86256]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:57:33 devstack cinder-volume[86256]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:57:33 devstack cinder-volume[86256]: we strongly recommend against using it for new projects. Jul 07 17:57:33 devstack cinder-volume[86256]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:57:33 devstack cinder-volume[86256]: framework. For more detail see Jul 07 17:57:33 devstack cinder-volume[86256]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:57:33 devstack cinder-volume[86256]: import eventlet # noqa Jul 07 17:57:35 devstack cinder-volume[86256]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86256) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:57:35 devstack cinder-volume[86256]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86256) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:57:35 devstack cinder-volume[86256]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86256) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:57:36 devstack cinder-volume[86256]: INFO dbcounter [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Registered counter for database cinder Jul 07 17:57:36 devstack cinder-volume[86256]: DEBUG oslo_db.sqlalchemy.engines [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:57:36 devstack cinder-volume[86256]: DEBUG dbcounter [-] [86256] Writer thread running {{(pid=86256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:57:36 devstack cinder-volume[86256]: INFO cinder.rpc [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:57:36 devstack cinder-volume[86256]: INFO cinder.rpc [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:57:36 devstack cinder-volume[86256]: DEBUG oslo_db.sqlalchemy.engines [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:57:36 devstack cinder-volume[86256]: INFO cinder.volume.manager [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Determined volume DB was empty at startup. Jul 07 17:57:36 devstack cinder-volume[86256]: DEBUG cinder.volume.manager [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86256) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:57:36 devstack cinder-volume[86256]: INFO cinder.volume.manager [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 17:57:36 devstack cinder-volume[86256]: WARNING stevedore.named [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:57:36 devstack cinder-volume[86256]: WARNING castellan.key_manager [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:57:36 devstack cinder-volume[86256]: WARNING cinder.keymgr.conf_key_mgr [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:57:36 devstack cinder-volume[86256]: INFO cinder.volume.manager [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:57:36 devstack cinder-volume[86256]: DEBUG oslo_db.sqlalchemy.engines [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:57:36 devstack cinder-volume[86256]: INFO oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Starting 1 workers Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Started child 86470 {{(pid=86256) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Full set of CONF: {{(pid=86256) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] ******************************************************************************** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Configuration options gathered from: {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] ================================================================================ {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] allow_availability_zone_fallback = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] allow_compression_on_image_upload = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] allowed_direct_url_schemes = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] api_rate_limit = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] auth_strategy = keystone {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_availability_zone = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_host = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_stats_polling_interval = 60 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86470]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backup_api_class = cinder.backup.api.API {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backup_name_template = backup-%s {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backup_use_same_host = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backup_use_temp_snapshot = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] chap_password = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] chap_username = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cinder_internal_tenant_project_id = 60a26170f39d4132ab7322594e71888c {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cinder_internal_tenant_user_id = dde7680f178e4363b29ed0441ed6817c {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cluster = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] compression_format = gzip {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] compute_api_class = cinder.compute.nova.API {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] config_dir = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] config_source = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] control_exchange = openstack {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] debug = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] default_availability_zone = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] default_group_type = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] default_volume_type = QuobyteHD {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] disk_geometry = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] driver_client_cert = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] driver_client_cert_key = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] driver_data_namespace = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] driver_ssl_cert_path = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] driver_ssl_cert_verify = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] driver_use_ssl = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] enable_new_services = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] enable_unsupported_driver = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] enabled_backends = ['QuobyteHD'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] enforce_multipath_for_image_xfer = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] filter_function = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_api_insecure = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_api_ssl_compression = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_ca_certificates_file = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_catalog_info = image:glance:publicURL {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_certfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_keyfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_num_retries = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance_request_timeout = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] goodness_function = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] graceful_shutdown_timeout = 5 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] group_api_class = cinder.group.api.API {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] host = devstack {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_compress_on_upload = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_conversion_address_space_limit = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_conversion_cpu_limit = 60 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_conversion_disable = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_upload_use_cinder_backend = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_upload_use_internal_tenant = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_volume_cache_enabled = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_volume_cache_max_count = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] image_volume_cache_max_size_gb = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] init_host_max_objects_retrieval = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] instance_format = [instance: %(uuid)s] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] iscsi_target_flags = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] iscsi_write_cache = on {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] iser_helper = tgtadm {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] iser_ip_address = 192.168.122.148 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] iser_port = 3260 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] log_color = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] log_config_append = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] log_dir = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] log_file = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] log_options = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] log_rotate_interval = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] log_rotate_interval_type = days {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] log_rotation_type = none {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] max_age = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] max_logfile_count = 30 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] max_logfile_size_mb = 200 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] max_over_subscription_ratio = 20.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] message_reap_interval = 86400 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] message_ttl = 2592000 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] migration_create_volume_timeout_secs = 300 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] monkey_patch = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] monkey_patch_modules = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] my_ip = 192.168.122.148 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] no_snapshot_gb_quota = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] num_iser_scan_tries = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86470]: INFO cinder.volume.manager [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:57:37 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.remotefs [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86470) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] num_shell_tries = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] num_volume_device_scan_tries = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] nvmeof_conn_info_version = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] nvmet_ns_id = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] nvmet_port_id = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] osapi_max_limit = 1000 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] osapi_volume_ext_list = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] osapi_volume_listen_port = 8776 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] osapi_volume_use_ssl = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] osapi_volume_workers = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] per_volume_size_limit = -1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] periodic_fuzzy_delay = 60 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] periodic_interval = 60 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] public_endpoint = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] publish_errors = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] quota_backup_gigabytes = 1000 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] quota_backups = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] quota_gigabytes = 1000 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] quota_groups = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] quota_snapshots = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] quota_volumes = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] rate_limit_burst = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] rate_limit_except_level = CRITICAL {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] rate_limit_interval = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] reinit_driver_count = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] replication_device = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] report_discard_supported = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] report_interval = 120 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] reservation_clean_interval = 86400 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] reservation_expire = 86400 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] reserved_image_namespaces = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] reserved_percentage = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] rpc_response_timeout = 120 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] run_external_periodic_tasks = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] scst_target_driver = iscsi {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] scst_target_iqn_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_down_time = 720 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] shell_completion = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] snapshot_name_template = snapshot-%s {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] split_loggers = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] state_path = /opt/stack/data/cinder {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] storage_availability_zone = nova {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] storage_protocol = iSCSI {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] syslog_log_facility = LOG_USER {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] target_helper = lioadm {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] target_ip_address = 192.168.122.148 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] target_port = 3260 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] target_protocol = iscsi {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] target_secondary_ip_addresses = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] trace_flags = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] transport_url = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] until_refresh = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] use_chap_auth = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] use_default_quota_class = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] use_journal = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] use_json = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] use_multipath_for_image_xfer = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] use_stderr = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] use_syslog = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] verify_glance_signatures = enabled {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_api_class = cinder.volume.api.API {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_backend_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_clear = zero {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_clear_ionice = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_clear_size = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_copy_bps_limit = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_dd_blocksize = 1M {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_name_template = volume-%s {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_service_inithost_offload = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volume_usage_audit_period = month {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] zoning_mode = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_concurrency.disable_process_locking = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.auth_section = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.auth_type = password {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.auth_version = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.cache = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.certfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.include_service_catalog = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.insecure = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.interface = public {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.keyfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_password = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86470) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:57:37 devstack cinder-volume[86470]: WARNING cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:57:37 devstack cinder-volume[86470]: WARNING cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcache_username = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.region_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Running cmd (subprocess): mount.quobyte {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.service_type = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.backend = dogpile.cache.null {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.backend_argument = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.backend_expiration_time = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.config_prefix = cache.oslo {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.debug_cache_backend = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.enable_retry_client = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.enable_socket_keepalive = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.enabled = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.expiration_time = 600 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.hashclient_retry_attempts = 2 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.memcache_dead_retry = 300 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.memcache_pool_maxsize = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.memcache_sasl_enabled = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.password = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.proxies = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.redis_db = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.redis_server = localhost:6379 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.retry_attempts = 2 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.retry_delay = 0.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.socket_keepalive_count = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.socket_keepalive_idle = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.socket_keepalive_interval = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.socket_timeout = 1.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.tls_allowed_ciphers = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.tls_cafile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.tls_certfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.tls_enabled = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.tls_keyfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cache.username = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] coordination.backend_url = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.asyncio_connection = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.asyncio_slave_connection = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.backend = sqlalchemy {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.connection = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.connection_debug = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.connection_parameters = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.connection_recycle_time = 3600 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.connection_trace = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.db_inc_retry_interval = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.db_max_retries = 20 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.db_max_retry_interval = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.db_retry_interval = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.max_overflow = 50 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.max_pool_size = 5 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.max_retries = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.mysql_wsrep_sync_wait = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.pool_timeout = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.retry_interval = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.slave_connection = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.sqlite_synchronous = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.synchronous_reader = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] database.use_db_reconnect = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.connection_string = messaging:// {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.enabled = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.es_doc_type = notification {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.es_scroll_size = 10000 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.es_scroll_time = 2m {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.filter_error_trace = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.hmac_keys = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.sentinel_service_name = mymaster {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.socket_timeout = 0.1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.trace_requests = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler.trace_sqlalchemy = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler_jaeger.process_tags = {} {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler_jaeger.service_name_prefix = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] profiler_otlp.service_name_prefix = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.enforce_new_defaults = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.enforce_scope = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.policy_default_rule = default {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.policy_file = policy.yaml {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] privsep_osbrick.group = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] privsep_osbrick.helper_command = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] privsep_osbrick.user = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cinder_sys_admin.group = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cinder_sys_admin.helper_command = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] cinder_sys_admin.user = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.auth_section = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.auth_type = password {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.cafile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.certfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.collect_timing = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.insecure = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.keyfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.send_service_user_token = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.split_loggers = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] service_user.timeout = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.auth_section = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.auth_type = password {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.certfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.collect_timing = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.insecure = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.keyfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.region_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.split_loggers = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] glance.timeout = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.backend_availability_zone = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.chap_password = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.chap_username = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.disk_geometry = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.driver_client_cert = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.driver_client_cert_key = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.driver_data_namespace = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.driver_use_ssl = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.extra_capabilities = {} {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.filter_function = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.goodness_function = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.iscsi_target_flags = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.iscsi_write_cache = on {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.iser_helper = tgtadm {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.iser_port = 3260 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_host = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_login = admin {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_mount_options = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_password = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_private_key = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_share_path = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack quobyte-client[86471]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.num_shell_tries = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack quobyte-client[86471]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.quobyte_volume_url = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] CMD "mount.quobyte" returned: 1 in 0.130s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.replication_device = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.report_discard_supported = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.reserved_percentage = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:37 devstack cinder-volume[86470]: INFO cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 ... Jul 07 17:57:37 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb -c /etc/quobyte/client-cinder.cfg {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.target_helper = tgtadm {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.target_port = 3260 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.target_protocol = iscsi {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.trace_flags = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.unique_fqdn_network = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.use_chap_auth = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.volume_backend_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.volume_clear = zero {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.volume_clear_ionice = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.volume_clear_size = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_reports.file_event_handler = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_reports.log_dir = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.backend_availability_zone = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.backend_host = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.chap_password = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.chap_username = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.chiscsi_conf = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.disk_geometry = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.driver_client_cert = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.driver_data_namespace = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.driver_use_ssl = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.extra_capabilities = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.filter_function = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.goodness_function = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb -c /etc/quobyte/client-cinder.cfg Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.iser_helper = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.iser_ip_address = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.iser_port = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.iser_target_prefix = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_host = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_login = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_mount_options = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_password = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_private_key = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_share_path = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_ssh_port = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.num_shell_tries = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.nvmet_port_id = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.replication_device = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.report_discard_supported = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.reserved_percentage = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.scst_target_driver = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.storage_protocol = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.target_helper = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.target_ip_address = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.target_port = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.target_prefix = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.target_protocol = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.trace_flags = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.use_chap_auth = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.volume_clear = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.volume_clear_size = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] QuobyteHD.volumes_dir = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.ssl = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_notifications.driver = [] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_notifications.retry = -1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] key_manager.fixed_key = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.barbican_api_version = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.barbican_endpoint = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.barbican_endpoint_type = public {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.barbican_region_name = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.cafile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.certfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.collect_timing = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.insecure = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.keyfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.number_of_retries = 60 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.retry_delay = 1 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.send_service_user_token = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.split_loggers = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.timeout = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.verify_ssl = True {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican.verify_ssl_path = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican_service_user.auth_section = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican_service_user.auth_type = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican_service_user.cafile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican_service_user.certfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican_service_user.collect_timing = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican_service_user.insecure = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican_service_user.keyfile = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican_service_user.split_loggers = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] barbican_service_user.timeout = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.approle_role_id = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.approle_secret_id = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.kv_mountpoint = secret {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.kv_path = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.kv_version = 2 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.namespace = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.root_token_id = **** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.ssl_ca_crt_file = None {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.timeout = 60.0 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.use_ssl = False {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:37 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] ******************************************************************************** {{(pid=86256) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:57:38 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:38 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.862s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:38 devstack cinder-volume[86470]: INFO cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 succeeded Jul 07 17:57:38 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:38 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.875s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:38 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:38 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:57:38 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:38 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:38 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.738s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:38 devstack cinder-volume[86470]: INFO cinder.volume.driver [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:57:38 devstack cinder-volume[86470]: DEBUG cinder.volume.driver [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710304260254, 'free_capacity_gb': 1775.710304260254, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86470) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG oslo_db.sqlalchemy.engines [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86470) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG dbcounter [-] [86470] Writer thread running {{(pid=86470) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG cinder.db.api [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Building query based on filter {{(pid=86470) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG cinder.image.image_utils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86470) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:57:39 devstack cinder-volume[86470]: INFO cinder.keymgr.migration [None req-fe5f61ff-2f44-4b10-a8e9-b2793ac6cb91 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:39 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:57:39 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:39 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.762s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG cinder.manager [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Notifying Schedulers of capabilities ... {{(pid=86470) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:39 devstack cinder-volume[86470]: INFO cinder.volume.manager [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Driver initialization completed successfully. Jul 07 17:57:39 devstack cinder-volume[86470]: INFO cinder.manager [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Initiating service 3 cleanup Jul 07 17:57:39 devstack cinder-volume[86470]: INFO cinder.manager [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Service 3 cleanup completed. Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG cinder.service [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Creating RPC server for service cinder-volume {{(pid=86470) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:57:39 devstack cinder-volume[86470]: DEBUG cinder.service [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86470) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:57:40 devstack cinder-volume[86470]: INFO cinder.volume.manager [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:57:40 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:40 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:40 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86470) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:40 devstack cinder-volume[86470]: DEBUG cinder.volume.drivers.quobyte [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86470) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:40 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86470) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:40 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:40 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:57:40 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:41 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:41 devstack cinder-volume[86470]: DEBUG oslo_concurrency.processutils [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.050s {{(pid=86470) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:41 devstack cinder-volume[86470]: INFO cinder.volume.manager [None req-ca0864e8-e465-4eec-b37d-18e5ea4db2ad None None] Driver post RPC initialization completed successfully. Jul 07 17:57:42 devstack cinder-volume[86256]: INFO oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Caught SIGTERM, stopping children Jul 07 17:57:42 devstack cinder-volume[86256]: DEBUG oslo_concurrency.lockutils [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Acquiring lock "singleton_lock" {{(pid=86256) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:57:42 devstack cinder-volume[86256]: DEBUG oslo_concurrency.lockutils [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Acquired lock "singleton_lock" {{(pid=86256) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:57:42 devstack cinder-volume[86256]: DEBUG oslo_concurrency.lockutils [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Releasing lock "singleton_lock" {{(pid=86256) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:57:42 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Stop services. {{(pid=86256) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 17:57:42 devstack cinder-volume[86256]: DEBUG oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Killing children. {{(pid=86256) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 17:57:42 devstack cinder-volume[86256]: INFO oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Waiting on 1 children to exit Jul 07 17:57:44 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Acquiring lock "singleton_lock" {{(pid=86470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:57:44 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Acquired lock "singleton_lock" {{(pid=86470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:57:44 devstack cinder-volume[86470]: DEBUG oslo_concurrency.lockutils [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Releasing lock "singleton_lock" {{(pid=86470) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:57:44 devstack cinder-volume[86470]: WARNING amqp [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:57:44 devstack cinder-volume[86470]: WARNING amqp [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 17:57:44 devstack cinder-volume[86256]: INFO oslo_service.backend._eventlet.service [None req-7631fb27-a451-463f-b25b-ff715de9fc50 None None] Child 86470 exited with status 0 Jul 07 17:57:44 devstack cinder-volume[86746]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 17:57:44 devstack cinder-volume[86746]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:57:44 devstack cinder-volume[86746]: we strongly recommend against using it for new projects. Jul 07 17:57:44 devstack cinder-volume[86746]: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:57:44 devstack cinder-volume[86746]: framework. For more detail see Jul 07 17:57:44 devstack cinder-volume[86746]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:57:44 devstack cinder-volume[86746]: import eventlet # noqa Jul 07 17:57:46 devstack cinder-volume[86746]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 17:57:46 devstack cinder-volume[86746]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 17:57:46 devstack cinder-volume[86746]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86746) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 17:57:48 devstack cinder-volume[86746]: INFO dbcounter [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Registered counter for database cinder Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_db.sqlalchemy.engines [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG dbcounter [-] [86746] Writer thread running {{(pid=86746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:57:48 devstack cinder-volume[86746]: INFO cinder.rpc [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 17:57:48 devstack cinder-volume[86746]: INFO cinder.rpc [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_db.sqlalchemy.engines [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:57:48 devstack cinder-volume[86746]: INFO cinder.volume.manager [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Determined volume DB was empty at startup. Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG cinder.volume.manager [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86746) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 17:57:48 devstack cinder-volume[86746]: WARNING stevedore.named [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 17:57:48 devstack cinder-volume[86746]: WARNING castellan.key_manager [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:57:48 devstack cinder-volume[86746]: WARNING cinder.keymgr.conf_key_mgr [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 17:57:48 devstack cinder-volume[86746]: INFO cinder.volume.manager [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_db.sqlalchemy.engines [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86746) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:57:48 devstack cinder-volume[86746]: INFO oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Starting 1 workers Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Started child 86972 {{(pid=86746) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Full set of CONF: {{(pid=86746) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] ******************************************************************************** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] Configuration options gathered from: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 17:57:48 devstack cinder-volume[86972]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] ================================================================================ {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] allow_availability_zone_fallback = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] allow_compression_on_image_upload = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] allowed_direct_url_schemes = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] api_rate_limit = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] auth_strategy = keystone {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_availability_zone = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_host = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_stats_polling_interval = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backup_api_class = cinder.backup.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backup_name_template = backup-%s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backup_use_same_host = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backup_use_temp_snapshot = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] chap_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] chap_username = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cinder_internal_tenant_project_id = 60a26170f39d4132ab7322594e71888c {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cinder_internal_tenant_user_id = dde7680f178e4363b29ed0441ed6817c {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cluster = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] compression_format = gzip {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] compute_api_class = cinder.compute.nova.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] config_dir = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] config_source = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] control_exchange = openstack {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] debug = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] default_availability_zone = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] default_group_type = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] default_volume_type = QuobyteHD {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] disk_geometry = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] driver_client_cert = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] driver_client_cert_key = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] driver_data_namespace = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] driver_ssl_cert_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] driver_ssl_cert_verify = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] driver_use_ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] enable_new_services = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] enable_unsupported_driver = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] enabled_backends = ['QuobyteHD'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] enforce_multipath_for_image_xfer = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] filter_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_api_insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_api_servers = ['http://192.168.122.148/image'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_api_ssl_compression = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_ca_certificates_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_catalog_info = image:glance:publicURL {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_num_retries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance_request_timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] goodness_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] graceful_shutdown_timeout = 5 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] group_api_class = cinder.group.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] host = devstack {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_compress_on_upload = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_conversion_address_space_limit = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_conversion_cpu_limit = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_conversion_disable = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_upload_use_cinder_backend = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_upload_use_internal_tenant = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_volume_cache_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_volume_cache_max_count = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] image_volume_cache_max_size_gb = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] init_host_max_objects_retrieval = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] instance_format = [instance: %(uuid)s] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] iscsi_target_flags = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] iscsi_write_cache = on {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] iser_helper = tgtadm {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] iser_ip_address = 192.168.122.148 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] iser_port = 3260 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] log_color = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] log_config_append = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] log_dir = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] log_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] log_options = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] log_rotate_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] log_rotate_interval_type = days {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] log_rotation_type = none {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] max_age = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] max_logfile_count = 30 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] max_logfile_size_mb = 200 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] max_over_subscription_ratio = 20.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] message_reap_interval = 86400 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] message_ttl = 2592000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] migration_create_volume_timeout_secs = 300 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] monkey_patch = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] monkey_patch_modules = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] my_ip = 192.168.122.148 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] no_snapshot_gb_quota = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] num_iser_scan_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] num_shell_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] num_volume_device_scan_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] nvmeof_conn_info_version = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] nvmet_ns_id = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] nvmet_port_id = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] osapi_max_limit = 1000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] osapi_volume_ext_list = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] osapi_volume_listen = 0.0.0.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] osapi_volume_listen_port = 8776 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] osapi_volume_use_ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] osapi_volume_workers = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] per_volume_size_limit = -1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] periodic_fuzzy_delay = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] periodic_interval = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] project_id_regex = [0-9a-f\-]+ {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] public_endpoint = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] publish_errors = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86972) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] quota_backup_gigabytes = 1000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] quota_backups = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] quota_gigabytes = 1000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] quota_groups = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] quota_snapshots = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] quota_volumes = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] rate_limit_burst = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] rate_limit_except_level = CRITICAL {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] rate_limit_interval = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] reinit_driver_count = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] replication_device = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] report_discard_supported = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] report_interval = 120 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] reservation_clean_interval = 86400 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] reservation_expire = 86400 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] reserved_image_namespaces = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] reserved_percentage = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] rpc_response_timeout = 120 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] run_external_periodic_tasks = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] scst_target_driver = iscsi {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] scst_target_iqn_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_down_time = 720 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] shell_completion = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] snapshot_name_template = snapshot-%s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] state_path = /opt/stack/data/cinder {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] storage_availability_zone = nova {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] storage_protocol = iSCSI {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] syslog_log_facility = LOG_USER {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] target_helper = lioadm {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] target_ip_address = 192.168.122.148 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] target_port = 3260 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] target_protocol = iscsi {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] target_secondary_ip_addresses = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] trace_flags = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] transfer_api_class = cinder.transfer.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] transport_url = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] until_refresh = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] use_chap_auth = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] use_default_quota_class = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] use_journal = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] use_json = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] use_multipath_for_image_xfer = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] use_stderr = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] use_syslog = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] verify_glance_signatures = enabled {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_api_class = cinder.volume.api.API {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_backend_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_clear = zero {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_clear_ionice = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_clear_size = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_copy_bps_limit = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_dd_blocksize = 1M {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_name_template = volume-%s {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_service_inithost_offload = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volume_usage_audit_period = month {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] zoning_mode = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_concurrency.disable_process_locking = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.auth_section = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.auth_type = password {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.auth_version = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.cache = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.delay_auth_decision = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.http_connect_timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.include_service_catalog = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.interface = public {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_password = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcache_username = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.region_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.service_token_roles_required = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.service_type = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.token_cache_time = 300 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.148/identity {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.backend = dogpile.cache.null {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.backend_argument = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.backend_expiration_time = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.config_prefix = cache.oslo {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.debug_cache_backend = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.enable_retry_client = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.enable_socket_keepalive = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.expiration_time = 600 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.hashclient_retry_attempts = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.memcache_dead_retry = 300 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.memcache_pool_maxsize = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.memcache_sasl_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.proxies = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.redis_db = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.redis_sentinel_service_name = mymaster {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86972) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 17:57:48 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.quobyte [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 17:57:48 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.quobyte [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.redis_server = localhost:6379 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.retry_attempts = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.retry_delay = 0.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.socket_keepalive_count = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.socket_keepalive_idle = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.socket_keepalive_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.socket_timeout = 1.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.tls_allowed_ciphers = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Running cmd (subprocess): mount.quobyte {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.tls_cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.tls_certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.tls_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.tls_keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cache.username = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] coordination.backend_url = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.asyncio_connection = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.asyncio_slave_connection = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.backend = sqlalchemy {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.connection = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.connection_debug = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.connection_parameters = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.connection_recycle_time = 3600 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.connection_trace = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.db_inc_retry_interval = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.db_max_retries = 20 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.db_max_retry_interval = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.db_retry_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.max_overflow = 50 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.max_pool_size = 5 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.max_retries = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.mysql_wsrep_sync_wait = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.pool_timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.retry_interval = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.slave_connection = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.sqlite_synchronous = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.synchronous_reader = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] database.use_db_reconnect = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.connection_string = messaging:// {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.es_doc_type = notification {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.es_scroll_size = 10000 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.es_scroll_time = 2m {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.filter_error_trace = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.hmac_keys = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.sentinel_service_name = mymaster {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.socket_timeout = 0.1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.trace_requests = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler.trace_sqlalchemy = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler_jaeger.process_tags = {} {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler_jaeger.service_name_prefix = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] profiler_otlp.service_name_prefix = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.enforce_new_defaults = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.enforce_scope = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.policy_default_rule = default {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.policy_file = policy.yaml {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_policy.remote_timeout = 60.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] privsep_osbrick.group = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] privsep_osbrick.helper_command = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] privsep_osbrick.user = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cinder_sys_admin.group = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cinder_sys_admin.helper_command = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] cinder_sys_admin.user = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.auth_section = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.auth_type = password {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.collect_timing = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.send_service_user_token = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] service_user.timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.auth_section = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.auth_type = password {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.collect_timing = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.region_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] glance.timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.backend_availability_zone = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.chap_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.chap_username = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.disk_geometry = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.driver_client_cert = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.driver_client_cert_key = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.driver_data_namespace = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.driver_use_ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.enable_unsupported_driver = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.extra_capabilities = {} {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.filter_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.goodness_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.iscsi_target_flags = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.iscsi_write_cache = on {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.iser_helper = tgtadm {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.iser_ip_address = 192.168.122.148 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.iser_port = 3260 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_host = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_login = admin {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_mount_options = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_private_key = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_share_path = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_ssh_port = 22 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.num_shell_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.nvmet_port_id = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.quobyte_client_cfg = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.quobyte_volume_url = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.replication_device = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.report_discard_supported = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.reserved_percentage = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.scst_target_driver = iscsi {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.scst_target_iqn_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.storage_protocol = iSCSI {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.target_helper = tgtadm {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.target_ip_address = 192.168.122.148 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.target_port = 3260 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.target_protocol = iscsi {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.trace_flags = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.unique_fqdn_network = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.use_chap_auth = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.volume_backend_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.volume_clear = zero {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.volume_clear_ionice = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.volume_clear_size = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_reports.file_event_handler = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_reports.log_dir = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.backend_availability_zone = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.backend_host = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.chap_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.chap_username = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.chiscsi_conf = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.disk_geometry = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.driver_client_cert = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.driver_client_cert_key = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.driver_data_namespace = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.driver_use_ssl = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.extra_capabilities = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.filter_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.goodness_function = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] CMD "mount.quobyte" returned: 1 in 0.104s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.iscsi_target_flags = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.iscsi_write_cache = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.iser_helper = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.iser_ip_address = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.iser_port = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.iser_target_prefix = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_host = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_login = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_mount_options = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_password = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_private_key = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_share_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_ssh_port = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.num_shell_tries = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nvmet_ns_id = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.nvmet_port_id = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.replication_device = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.report_discard_supported = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.reserved_percentage = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.scst_target_driver = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.storage_protocol = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.target_helper = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.target_ip_address = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.target_port = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.target_prefix = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.target_protocol = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.trace_flags = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.unique_fqdn_network = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.use_chap_auth = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.volume_clear = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.volume_clear_ionice = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.volume_clear_size = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] QuobyteHD.volumes_dir = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:48 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.ssl_version = {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_notifications.driver = [] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_notifications.retry = -1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] oslo_messaging_notifications.transport_url = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] key_manager.fixed_key = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.barbican_api_version = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.barbican_endpoint = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.barbican_endpoint_type = public {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.barbican_region_name = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.collect_timing = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.number_of_retries = 60 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.retry_delay = 1 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.send_service_user_token = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.verify_ssl = True {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican.verify_ssl_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican_service_user.auth_section = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican_service_user.auth_type = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican_service_user.cafile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican_service_user.certfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican_service_user.collect_timing = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican_service_user.insecure = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican_service_user.keyfile = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican_service_user.split_loggers = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] barbican_service_user.timeout = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.approle_role_id = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.approle_secret_id = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.kv_mountpoint = secret {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.kv_path = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.kv_version = 2 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.namespace = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.root_token_id = **** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.ssl_ca_crt_file = None {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.timeout = 60.0 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.use_ssl = False {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 17:57:49 devstack cinder-volume[86746]: DEBUG oslo_service.backend._eventlet.service [None req-e95795e6-791c-416c-8736-8f773f52a7bd None None] ******************************************************************************** {{(pid=86746) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 17:57:49 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.879s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:49 devstack cinder-volume[86972]: INFO cinder.volume.driver [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 17:57:49 devstack cinder-volume[86972]: DEBUG cinder.volume.driver [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710304260254, 'free_capacity_gb': 1775.710304260254, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86972) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG oslo_db.sqlalchemy.engines [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86972) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writer thread running {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG cinder.db.api [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Building query based on filter {{(pid=86972) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86972) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:50 devstack cinder-volume[86972]: INFO cinder.keymgr.migration [None req-0ac1d3f1-7281-4df8-9d3e-80ba520f7226 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 17:57:50 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:57:50 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:50 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.826s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:50 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:57:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Driver initialization completed successfully. Jul 07 17:57:51 devstack cinder-volume[86972]: INFO cinder.manager [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Initiating service 3 cleanup Jul 07 17:57:51 devstack cinder-volume[86972]: INFO cinder.manager [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Service 3 cleanup completed. Jul 07 17:57:51 devstack cinder-volume[86972]: DEBUG cinder.service [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Creating RPC server for service cinder-volume {{(pid=86972) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 17:57:51 devstack cinder-volume[86972]: DEBUG cinder.service [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86972) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 17:57:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 17:57:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:57:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:57:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:57:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:57:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:57:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:57:51 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:57:51 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:57:51 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Jul 07 17:57:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.648s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:57:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-874f26a6-da5b-430f-9f96-ed8d7851ffb3 None None] Driver post RPC initialization completed successfully. Jul 07 17:57:58 devstack cinder-volume[86746]: DEBUG dbcounter [-] [86746] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86746) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:58:01 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=3 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:58:01 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:58:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:58:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 6 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:58:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Flow 'volume_create_manager' (85381b19-3b4d-48b1-858c-816fc31780ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edf5149-f88f-4ef0-9aa5-08f5ab7059b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edf5149-f88f-4ef0-9aa5-08f5ab7059b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-84602065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac8a030-a638-4f08-9d8f-2d5caa5076f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97319e219b0b4140ac629c6edb4ae37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:49Z,use_quota=True,user_id='9538ee9610eb494d8d6cc4768670ddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0966d7-b912-48f3-896d-8ea7a72ed5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0966d7-b912-48f3-896d-8ea7a72ed5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dd1c90-3656-446a-a118-15e205299855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dd1c90-3656-446a-a118-15e205299855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac8a030-a638-4f08-9d8f-2d5caa5076f2', 'volume_name': 'volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfacad3-43b4-4c9b-a203-ab2679baf55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfacad3-43b4-4c9b-a203-ab2679baf55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadff0a2-bfa5-43cd-b96e-9f6b2e624faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:49 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Volume eac8a030-a638-4f08-9d8f-2d5caa5076f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2', 'volume_size': 1} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-84602065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac8a030-a638-4f08-9d8f-2d5caa5076f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97319e219b0b4140ac629c6edb4ae37a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:49Z,use_quota=True,user_id='9538ee9610eb494d8d6cc4768670ddb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Creating volume eac8a030-a638-4f08-9d8f-2d5caa5076f2 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:49 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:49 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 1073741824 Jul 07 17:58:49 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:49 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Flow 'volume_create_manager' (ed30ae2c-a82a-4fc1-a310-cce37df1b7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e62fcf-04d2-4b26-beb3-8f90f771264a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e62fcf-04d2-4b26-beb3-8f90f771264a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-452081575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3018a211-05f6-4e7e-ad69-f33a4743f55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839a0196232442929a7d00dd9b697746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:49Z,use_quota=True,user_id='c9f7ee85bd0741a69f9f94cff9cc6078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c712fbe3-dfde-42d8-b035-eb96902fae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c712fbe3-dfde-42d8-b035-eb96902fae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acc10aa-c222-48e7-91ae-7e463914a841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acc10aa-c222-48e7-91ae-7e463914a841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3018a211-05f6-4e7e-ad69-f33a4743f55c', 'volume_name': 'volume-3018a211-05f6-4e7e-ad69-f33a4743f55c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1450a6ef-da30-42e6-be7a-c4b2d513ccea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1450a6ef-da30-42e6-be7a-c4b2d513ccea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f19d97-bc9c-41f1-ad09-975ac96a8265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:50 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Volume 3018a211-05f6-4e7e-ad69-f33a4743f55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3018a211-05f6-4e7e-ad69-f33a4743f55c', 'volume_size': 1} Jul 07 17:58:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:52 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 1073741824" returned: 0 in 2.099s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:52 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 Jul 07 17:58:52 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:53 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2" returned: 0 in 1.314s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] <== create_volume: return (3543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.552s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.373s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-452081575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3018a211-05f6-4e7e-ad69-f33a4743f55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='839a0196232442929a7d00dd9b697746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:58:49Z,use_quota=True,user_id='c9f7ee85bd0741a69f9f94cff9cc6078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Creating volume 3018a211-05f6-4e7e-ad69-f33a4743f55c {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:58:53 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:53 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c 1073741824 Jul 07 17:58:53 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadff0a2-bfa5-43cd-b96e-9f6b2e624faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f07ca6-8090-4a19-a548-7fdefeb0cc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Volume volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 (eac8a030-a638-4f08-9d8f-2d5caa5076f2): created successfully Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f07ca6-8090-4a19-a548-7fdefeb0cc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Flow 'volume_create_manager' (85381b19-3b4d-48b1-858c-816fc31780ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-576bb923-1f2c-4e1c-9d9e-e620ec23430c tempest-DeleteServersTestJSON-1494618227 None] Created volume successfully. Jul 07 17:58:55 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c 1073741824" returned: 0 in 1.906s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:58:55 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c Jul 07 17:58:55 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:56 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Jul 07 17:58:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c" returned: 0 in 1.190s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:58:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] <== create_volume: return (3217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:58:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.226s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:58:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31f19d97-bc9c-41f1-ad09-975ac96a8265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3018a211-05f6-4e7e-ad69-f33a4743f55c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d74d49-dd2a-4d2c-8baf-a41ca2e86df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:58:56 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Volume volume-3018a211-05f6-4e7e-ad69-f33a4743f55c (3018a211-05f6-4e7e-ad69-f33a4743f55c): created successfully Jul 07 17:58:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d74d49-dd2a-4d2c-8baf-a41ca2e86df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:58:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Flow 'volume_create_manager' (ed30ae2c-a82a-4fc1-a310-cce37df1b7ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:58:56 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-d02dda36-1d4c-4e10-960a-a70871114078 req-d8d4dd62-0044-4318-86f1-47cce33ae820 tempest-VolumesSnapshotsTestJSON-1962435695 None] Created volume successfully. Jul 07 17:58:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:58:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:58:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Creating offline snapshot 367f6a4c-0f06-4995-89f4-b83fe5ef980d of volume 3018a211-05f6-4e7e-ad69-f33a4743f55c {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 17:58:58 devstack cinder-volume[86972]: INFO oslo.privsep.daemon [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr7keb127/privsep.sock'] Jul 07 17:58:58 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr7keb127/privsep.sock Jul 07 17:58:58 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:58:59 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 17:58:59 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:58:59 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:58:59 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:58:59 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:58:59 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:58:59 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:58:59 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:58:59 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 17:59:01 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 17:59:01 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 17:59:01 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 17:59:01 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:59:01 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 17:59:01 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 17:59:01 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 17:59:01 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 17:59:01 devstack cinder-volume[86972]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Flow 'volume_create_manager' (4f56ca49-2606-46b8-9501-ed41cdfde40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e97f088-ab29-4c88-a2cd-d87112d5af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e97f088-ab29-4c88-a2cd-d87112d5af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1168247888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e2a6438462479ba3312004306f6dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:02Z,use_quota=True,user_id='6aad2cedbad14ab79b86e072a65d3af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b4e5ea-9163-4694-94f7-01ad2adcc8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b4e5ea-9163-4694-94f7-01ad2adcc8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c37516f-5a00-4d8f-ae79-2ddff93f2357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c37516f-5a00-4d8f-ae79-2ddff93f2357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9', 'volume_name': 'volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653bbbde-2d89-44b1-aa76-4da8b63fbe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653bbbde-2d89-44b1-aa76-4da8b63fbe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af191ab7-f3a4-413a-9483-186b5051ebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:01 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Volume 7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9', 'volume_size': 1} Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:01 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:01 devstack cinder-volume[86972]: INFO oslo.privsep.daemon [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Spawned new privsep daemon via rootwrap Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Accepted privsep connection to /tmp/tmpr7keb127/privsep.sock {{(pid=86972) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 17:59:01 devstack cinder-volume[86972]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 17:59:01 devstack cinder-volume[86972]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 17:59:01 devstack cinder-volume[86972]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 17:59:01 devstack cinder-volume[86972]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88280 Jul 07 17:59:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3be157f-d89e-4f09-9979-d1e9234ced99]: (2,) {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:02 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ec6a69-68fa-49cd-8829-12d8604a1786]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:02 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c Jul 07 17:59:02 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:03 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c" returned: 0 in 1.189s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:03 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d 1G Jul 07 17:59:03 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:03 devstack cinder-volume[86972]: WARNING py.warnings [req-0fbafc1a-398a-4e77-ac93-4b6828829af1 req-869ed263-1185-4957-9e77-86e0b195654a tempest-DeleteServersTestJSON-1494618227 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 07 17:59:03 devstack cinder-volume[86972]: .first() Jul 07 17:59:03 devstack cinder-volume[86972]: Jul 07 17:59:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-0fbafc1a-398a-4e77-ac93-4b6828829af1 req-869ed263-1185-4957-9e77-86e0b195654a tempest-DeleteServersTestJSON-1494618227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:04 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d 1G" returned: 0 in 1.046s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3018a211-05f6-4e7e-ad69-f33a4743f55c -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:04 devstack sudo[88307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3018a211-05f6-4e7e-ad69-f33a4743f55c -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d Jul 07 17:59:04 devstack sudo[88307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:05 devstack sudo[88307]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3018a211-05f6-4e7e-ad69-f33a4743f55c -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d" returned: 0 in 0.860s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:05 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d is being set with open permissions: ugo+rw Jul 07 17:59:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:05 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d Jul 07 17:59:05 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:05 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d" returned: 0 in 0.735s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:05 devstack sudo[88317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.info Jul 07 17:59:05 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:06 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.info" returned: 0 in 0.868s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:06 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.info is being set with open permissions: ugo+rw Jul 07 17:59:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:06 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.info Jul 07 17:59:06 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:07 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.info" returned: 0 in 0.919s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.404s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1168247888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36e2a6438462479ba3312004306f6dcf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:02Z,use_quota=True,user_id='6aad2cedbad14ab79b86e072a65d3af5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Creating volume 7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:07 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 17:59:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:07 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 1073741824 Jul 07 17:59:07 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-9f636ef3-e204-466d-9fc7-a7625ba13edc req-21405da2-bc0c-4b76-b180-ef0b851d6e8f tempest-VolumesSnapshotsTestJSON-1962435695 None] Create snapshot completed successfully Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Acquiring lock "cinder-367f6a4c-0f06-4995-89f4-b83fe5ef980d-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-367f6a4c-0f06-4995-89f4-b83fe5ef980d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Acquiring lock "cinder-quobyte-3018a211-05f6-4e7e-ad69-f33a4743f55c" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-quobyte-3018a211-05f6-4e7e-ad69-f33a4743f55c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Acquiring lock "cinder-quobyte-367f6a4c-0f06-4995-89f4-b83fe5ef980d" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-quobyte-367f6a4c-0f06-4995-89f4-b83fe5ef980d" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Deleting offline snapshot 367f6a4c-0f06-4995-89f4-b83fe5ef980d of volume 3018a211-05f6-4e7e-ad69-f33a4743f55c {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] snapshot_file for this snap is: volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa64264-21e8-4fde-81ee-fa9333432b1c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:08 devstack sudo[88326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d Jul 07 17:59:08 devstack sudo[88326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:09 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 1073741824" returned: 0 in 2.147s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:10 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 Jul 07 17:59:10 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:10 devstack sudo[88326]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d" returned: 0 in 1.632s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3018a211-05f6-4e7e-ad69-f33a4743f55c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 17:59:10 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d583fd80-26bf-4033-b363-db1323110c1a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:10 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c Jul 07 17:59:10 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:11 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9" returned: 0 in 1.159s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] <== create_volume: return (3421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.426s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-0fbafc1a-398a-4e77-ac93-4b6828829af1 req-869ed263-1185-4957-9e77-86e0b195654a tempest-DeleteServersTestJSON-1494618227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.248s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af191ab7-f3a4-413a-9483-186b5051ebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cd7140-860f-4ca7-95a8-2d7a445f149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ea25aa-594d-4b15-b78b-57dca16f30c3]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-0fbafc1a-398a-4e77-ac93-4b6828829af1 req-869ed263-1185-4957-9e77-86e0b195654a tempest-DeleteServersTestJSON-1494618227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:11 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Volume volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 (7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9): created successfully Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cd7140-860f-4ca7-95a8-2d7a445f149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Flow 'volume_create_manager' (4f56ca49-2606-46b8-9501-ed41cdfde40d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4a82d803-69f0-4f6f-bd6b-80cccef6d85c tempest-ServerRescueNegativeTestJSON-368272265 None] Created volume successfully. Jul 07 17:59:11 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 Jul 07 17:59:11 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:12 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c" returned: 0 in 2.072s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:12 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d Jul 07 17:59:12 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:12 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:59:12 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:12 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-0fbafc1a-398a-4e77-ac93-4b6828829af1 req-869ed263-1185-4957-9e77-86e0b195654a tempest-DeleteServersTestJSON-1494618227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2" returned: 0 in 1.681s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-0fbafc1a-398a-4e77-ac93-4b6828829af1 req-869ed263-1185-4957-9e77-86e0b195654a tempest-DeleteServersTestJSON-1494618227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.728s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-0fbafc1a-398a-4e77-ac93-4b6828829af1 req-869ed263-1185-4957-9e77-86e0b195654a tempest-DeleteServersTestJSON-1494618227 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5441949c-cb2a-4727-a4dd-0998c722e69d', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 17:59:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-0fbafc1a-398a-4e77-ac93-4b6828829af1 req-869ed263-1185-4957-9e77-86e0b195654a tempest-DeleteServersTestJSON-1494618227 None] attachment_update completed successfully. Jul 07 17:59:13 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d" returned: 0 in 1.311s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:13 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d Jul 07 17:59:13 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:14 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.315s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:14 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:14 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 17:59:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 8 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 17:59:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 17:59:14 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c.367f6a4c-0f06-4995-89f4-b83fe5ef980d" returned: 0 in 1.314s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:14 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-quobyte-367f6a4c-0f06-4995-89f4-b83fe5ef980d" released by "_delete_snapshot" :: held 6.578s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:14 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-quobyte-3018a211-05f6-4e7e-ad69-f33a4743f55c" released by "delete_snapshot" :: held 6.665s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:15 devstack cinder-volume[86972]: WARNING cinder.quota [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:59:15 devstack cinder-volume[86972]: WARNING cinder.quota [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:59:15 devstack cinder-volume[86972]: DEBUG cinder.quota [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Created reservations ['98ca8ef2-eaa2-4d66-8276-a9095677ddf5', 'dc537e91-3b12-4887-bf82-7556ea84d7c1', '9d164047-a921-4437-8b90-27514bf52759', '7b9d2f4a-631a-4061-a8e1-75d1734a138b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Delete snapshot completed successfully. Jul 07 17:59:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-c42abd0c-b2ce-403a-b346-5ee887dae030 req-52e9ea50-a977-459b-abc6-5f4649069d40 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-367f6a4c-0f06-4995-89f4-b83fe5ef980d-delete_snapshot" released by "delete_snapshot" :: held 7.011s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Acquiring lock "cinder-3018a211-05f6-4e7e-ad69-f33a4743f55c-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-3018a211-05f6-4e7e-ad69-f33a4743f55c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Acquiring lock "cinder-quobyte-3018a211-05f6-4e7e-ad69-f33a4743f55c" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-quobyte-3018a211-05f6-4e7e-ad69-f33a4743f55c" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:16 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[556a128d-7145-4dc8-8efd-e53aba8ab5c8]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:16 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c Jul 07 17:59:16 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:17 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c" returned: 0 in 0.835s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:17 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c Jul 07 17:59:17 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:17 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3018a211-05f6-4e7e-ad69-f33a4743f55c" returned: 0 in 0.701s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-quobyte-3018a211-05f6-4e7e-ad69-f33a4743f55c" released by "delete_volume" :: held 1.610s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:17 devstack cinder-volume[86972]: WARNING cinder.quota [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG cinder.quota [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Created reservations ['b0ce730f-ab55-4c68-bbbb-ff43fcd572da', '46fecedc-67f1-4aeb-a427-3e3e0f2c01b0', '2e976508-4eb3-439f-9faf-7025d4430954', '743646e7-b69f-4e97-bb78-182d909c41e7'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:17 devstack sudo[88820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:59:17 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:18 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.969s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:18 devstack cinder-volume[86972]: DEBUG cinder.manager [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:18 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Deleted volume successfully. Jul 07 17:59:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-fa79e2a2-3978-41aa-b5c5-4133e2777171 req-1ad3fdb4-a03d-4b94-abe7-da7b78c92592 tempest-VolumesSnapshotsTestJSON-1962435695 None] Lock "cinder-3018a211-05f6-4e7e-ad69-f33a4743f55c-delete_volume" released by "delete_volume" :: held 2.877s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-f404b818-1ee7-4c35-9c47-6dc2c112fd4c req-184228d0-4cfd-4470-aec5-b4747a4146c7 tempest-DeleteServersTestJSON-1494618227 None] Terminate volume connection completed successfully. Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-f404b818-1ee7-4c35-9c47-6dc2c112fd4c req-184228d0-4cfd-4470-aec5-b4747a4146c7 tempest-DeleteServersTestJSON-1494618227 None] Deleting attachment 5441949c-cb2a-4727-a4dd-0998c722e69d. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Flow 'volume_create_manager' (3851efc3-c4ee-4bb5-bc3d-56084fb98ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0969857-9704-4fd2-8525-88b8341aeb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0969857-9704-4fd2-8525-88b8341aeb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1461419733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49aff3d9-3866-4b37-972e-08ca42c0deed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49dc185b770446798eb5ff3d7d3013ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:24Z,use_quota=True,user_id='678dc7e53d3d490b96992dc40ce050b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67967ec0-feb3-4275-9e08-b81ec7dd52ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67967ec0-feb3-4275-9e08-b81ec7dd52ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5858cb6d-dad8-4481-b798-615a6cb9cdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5858cb6d-dad8-4481-b798-615a6cb9cdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49aff3d9-3866-4b37-972e-08ca42c0deed', 'volume_name': 'volume-49aff3d9-3866-4b37-972e-08ca42c0deed', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12649e58-efd2-4f0b-8812-ffec9970b849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12649e58-efd2-4f0b-8812-ffec9970b849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91382083-3038-4a76-9a66-e5db26b3a117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:24 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Volume 49aff3d9-3866-4b37-972e-08ca42c0deed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49aff3d9-3866-4b37-972e-08ca42c0deed', 'volume_size': 1} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1461419733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49aff3d9-3866-4b37-972e-08ca42c0deed,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49dc185b770446798eb5ff3d7d3013ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:24Z,use_quota=True,user_id='678dc7e53d3d490b96992dc40ce050b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Creating volume 49aff3d9-3866-4b37-972e-08ca42c0deed {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:24 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 17:59:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:24 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed 1073741824 Jul 07 17:59:24 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:26 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed 1073741824" returned: 0 in 2.008s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:26 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed Jul 07 17:59:26 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:27 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed" returned: 0 in 1.255s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] <== create_volume: return (3382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.384s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91382083-3038-4a76-9a66-e5db26b3a117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49aff3d9-3866-4b37-972e-08ca42c0deed', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1e9bad-73ba-426c-b02c-3c727657bcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:27 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Volume volume-49aff3d9-3866-4b37-972e-08ca42c0deed (49aff3d9-3866-4b37-972e-08ca42c0deed): created successfully Jul 07 17:59:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1e9bad-73ba-426c-b02c-3c727657bcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Flow 'volume_create_manager' (3851efc3-c4ee-4bb5-bc3d-56084fb98ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d6934c4c-67c1-43c5-b66e-fedf32372ac9 tempest-VolumesTestJSON-1561133942 None] Created volume successfully. Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Acquiring lock "cinder-eac8a030-a638-4f08-9d8f-2d5caa5076f2-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Lock "cinder-eac8a030-a638-4f08-9d8f-2d5caa5076f2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Acquiring lock "cinder-quobyte-eac8a030-a638-4f08-9d8f-2d5caa5076f2" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Lock "cinder-quobyte-eac8a030-a638-4f08-9d8f-2d5caa5076f2" acquired by "delete_volume" :: waited 0.030s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7f1397-b92a-4285-b314-39217ea20757]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:59:29 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 Jul 07 17:59:29 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Flow 'volume_create_manager' (9a900215-3ab9-4ee0-ac7a-8771b2d402ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45820762-435d-4511-9c08-99c83c4530e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45820762-435d-4511-9c08-99c83c4530e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-157242709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8a1e6b-536a-4137-94b9-23fbe84ffc4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49dc185b770446798eb5ff3d7d3013ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:30Z,use_quota=True,user_id='678dc7e53d3d490b96992dc40ce050b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc3fa52-5a85-4b68-ae3d-36268c630300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc3fa52-5a85-4b68-ae3d-36268c630300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b906b6-8aa6-4a8b-b9ce-01f3de81b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b906b6-8aa6-4a8b-b9ce-01f3de81b888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8a1e6b-536a-4137-94b9-23fbe84ffc4d', 'volume_name': 'volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cb9eb5-2bc1-41d6-a116-9cb5bbf96a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cb9eb5-2bc1-41d6-a116-9cb5bbf96a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df48a6bd-2c21-4380-b106-f2d36f72488f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:29 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Volume ea8a1e6b-536a-4137-94b9-23fbe84ffc4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d', 'volume_size': 1} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-157242709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8a1e6b-536a-4137-94b9-23fbe84ffc4d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49dc185b770446798eb5ff3d7d3013ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:30Z,use_quota=True,user_id='678dc7e53d3d490b96992dc40ce050b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Creating volume ea8a1e6b-536a-4137-94b9-23fbe84ffc4d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:29 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 17:59:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:29 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d 1073741824 Jul 07 17:59:29 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:30 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2" returned: 0 in 1.217s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:30 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2 Jul 07 17:59:30 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:31 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d 1073741824" returned: 0 in 1.191s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:31 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d Jul 07 17:59:31 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:31 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eac8a030-a638-4f08-9d8f-2d5caa5076f2" returned: 0 in 0.769s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Lock "cinder-quobyte-eac8a030-a638-4f08-9d8f-2d5caa5076f2" released by "delete_volume" :: held 2.084s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Created reservations ['8af8e6cf-45a8-482d-9ef1-bcffd599c429', 'ea0d4533-4c53-47ad-9e3f-4df2a88e2958', '7531a503-4b97-47e2-8663-ff000741846e', '040513d5-23b5-40fa-9689-8ef7a36b3cad'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:31 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:59:31 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:32 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d" returned: 0 in 1.058s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] <== create_volume: return (2318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.321s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df48a6bd-2c21-4380-b106-f2d36f72488f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e599d8-263b-4005-b3e6-b6e61a071303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:32 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Volume volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d (ea8a1e6b-536a-4137-94b9-23fbe84ffc4d): created successfully Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e599d8-263b-4005-b3e6-b6e61a071303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Flow 'volume_create_manager' (9a900215-3ab9-4ee0-ac7a-8771b2d402ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:32 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1a74d8ba-568e-4503-8159-be19bb6f4ce9 tempest-VolumesTestJSON-1561133942 None] Created volume successfully. Jul 07 17:59:32 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:32 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Deleted volume successfully. Jul 07 17:59:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3d30bcc5-a5b8-467b-857b-3c2c5bba5fe7 tempest-DeleteServersTestJSON-1494618227 None] Lock "cinder-eac8a030-a638-4f08-9d8f-2d5caa5076f2-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:33 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 17:59:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Flow 'volume_create_manager' (0ea8d145-05d9-4ed1-ab58-915b3b17fe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62ce0cd-9aa4-4df2-ae1a-7f6aec58f822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62ce0cd-9aa4-4df2-ae1a-7f6aec58f822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637964436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecddd551-0849-4590-aa63-9deb0ae6ac3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49dc185b770446798eb5ff3d7d3013ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:34Z,use_quota=True,user_id='678dc7e53d3d490b96992dc40ce050b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d58828-c5ab-41b6-b7a3-4945c42f0f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d58828-c5ab-41b6-b7a3-4945c42f0f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c29b75-7b23-4477-9aa5-9774b3f320a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c29b75-7b23-4477-9aa5-9774b3f320a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecddd551-0849-4590-aa63-9deb0ae6ac3a', 'volume_name': 'volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f95473b-9d0a-46ca-b13f-e6386ad8645c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f95473b-9d0a-46ca-b13f-e6386ad8645c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3339c1a-7c27-4300-ab3a-2979e765b7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:34 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Volume ecddd551-0849-4590-aa63-9deb0ae6ac3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a', 'volume_size': 1} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T15:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1637964436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecddd551-0849-4590-aa63-9deb0ae6ac3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49dc185b770446798eb5ff3d7d3013ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T15:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T15:59:34Z,use_quota=True,user_id='678dc7e53d3d490b96992dc40ce050b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Creating volume ecddd551-0849-4590-aa63-9deb0ae6ac3a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 17:59:34 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 17:59:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:34 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a 1073741824 Jul 07 17:59:34 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:35 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a 1073741824" returned: 0 in 1.113s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:35 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a Jul 07 17:59:35 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Acquiring lock "cinder-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "cinder-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Acquiring lock "cinder-quobyte-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "cinder-quobyte-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f44d2d-211e-47f8-8555-2d0121411e6c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:36 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 Jul 07 17:59:36 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:36 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a" returned: 0 in 1.093s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] <== create_volume: return (2265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 17:59:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3339c1a-7c27-4300-ab3a-2979e765b7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6237316e-ce8f-45a5-8a45-afe78d5de3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 17:59:36 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Volume volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a (ecddd551-0849-4590-aa63-9deb0ae6ac3a): created successfully Jul 07 17:59:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6237316e-ce8f-45a5-8a45-afe78d5de3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 17:59:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Flow 'volume_create_manager' (0ea8d145-05d9-4ed1-ab58-915b3b17fe61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 17:59:36 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6f0cd8f2-bc05-43ae-a46f-5b7a8471ec53 tempest-VolumesTestJSON-1561133942 None] Created volume successfully. Jul 07 17:59:37 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9" returned: 0 in 1.255s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:37 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9 Jul 07 17:59:37 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:38 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9" returned: 0 in 1.193s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "cinder-quobyte-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9" released by "delete_volume" :: held 2.506s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Created reservations ['3a92f1ee-940a-4dcf-a849-4c2c149a8ee5', '41d93ce8-9eab-4577-9012-2511e7f60dc3', '5e8f5ead-ff29-4560-9317-f2c13906a1f2', '827c767b-a28e-4747-b643-06a149d2fb02'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:38 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:59:38 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Acquiring lock "cinder-ecddd551-0849-4590-aa63-9deb0ae6ac3a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Lock "cinder-ecddd551-0849-4590-aa63-9deb0ae6ac3a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Acquiring lock "cinder-quobyte-ecddd551-0849-4590-aa63-9deb0ae6ac3a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Lock "cinder-quobyte-ecddd551-0849-4590-aa63-9deb0ae6ac3a" acquired by "delete_volume" :: waited 0.049s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:39 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0240f73b-d40e-43e4-b59e-23357b4658ec]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:39 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a Jul 07 17:59:39 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:40 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.719s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:40 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Deleted volume successfully. Jul 07 17:59:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eef2b293-f1a5-4221-b871-13fb5410b612 tempest-ServerRescueNegativeTestJSON-368272265 None] Lock "cinder-7ccf848a-c4c3-4f0b-b498-7aaa07bccfb9-delete_volume" released by "delete_volume" :: held 4.705s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:40 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a" returned: 0 in 1.763s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:40 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a Jul 07 17:59:40 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:42 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ecddd551-0849-4590-aa63-9deb0ae6ac3a" returned: 0 in 1.364s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Lock "cinder-quobyte-ecddd551-0849-4590-aa63-9deb0ae6ac3a" released by "delete_volume" :: held 3.210s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=46,cinder:UPDATE=55,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=47,cinder:SELECT=43,cinder:DELETE=6,cinder:INSERT=11 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Created reservations ['4280e103-eee5-40a8-aa53-f824f0a4e301', 'b35e190c-6bea-4a92-9438-0dc801a9c334', '1f5ad38d-5997-4673-89ac-bb79b1802197', 'ab38a5f7-3852-476a-8809-c6b75b357fdd'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:42 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:59:42 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Acquiring lock "cinder-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Lock "cinder-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:43 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.114s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:43 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:43 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Deleted volume successfully. Jul 07 17:59:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Acquiring lock "cinder-quobyte-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-997e171b-8050-4c15-8e28-2353273b78db tempest-VolumesTestJSON-1561133942 None] Lock "cinder-ecddd551-0849-4590-aa63-9deb0ae6ac3a-delete_volume" released by "delete_volume" :: held 4.979s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Lock "cinder-quobyte-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:44 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b5aba1-53e7-426d-83d4-f6f2da56bcb0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:44 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d Jul 07 17:59:44 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:45 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d" returned: 0 in 1.161s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:45 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d Jul 07 17:59:45 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:46 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d" returned: 0 in 0.957s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Lock "cinder-quobyte-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d" released by "delete_volume" :: held 2.182s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:46 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Created reservations ['5408b191-7688-4922-9411-2891643eecdd', '57c18d00-041d-423b-b692-9d9ace8a3854', '8caf767c-6dc6-474b-a2b7-874b6c83a376', 'a167eac2-3a14-48f6-aed4-2ae30f4f1163'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:46 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:59:46 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:47 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.877s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:47 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:47 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Deleted volume successfully. Jul 07 17:59:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Acquiring lock "cinder-49aff3d9-3866-4b37-972e-08ca42c0deed-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1ce7a90-cde3-45fb-9360-82b775b7d146 tempest-VolumesTestJSON-1561133942 None] Lock "cinder-ea8a1e6b-536a-4137-94b9-23fbe84ffc4d-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Lock "cinder-49aff3d9-3866-4b37-972e-08ca42c0deed-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Acquiring lock "cinder-quobyte-49aff3d9-3866-4b37-972e-08ca42c0deed" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 17:59:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Lock "cinder-quobyte-49aff3d9-3866-4b37-972e-08ca42c0deed" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 17:59:47 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe92f11-6acd-413c-bf9b-f4357e7adc71]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 17:59:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:47 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed Jul 07 17:59:47 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:48 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed" returned: 0 in 1.219s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:48 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed Jul 07 17:59:48 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:49 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-49aff3d9-3866-4b37-972e-08ca42c0deed" returned: 0 in 0.834s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Lock "cinder-quobyte-49aff3d9-3866-4b37-972e-08ca42c0deed" released by "delete_volume" :: held 2.108s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 17:59:49 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Created reservations ['10ae6653-0fb9-4312-95d5-a9f166f13dd6', '706d1444-1d0d-40d8-a455-8cf172fc1f17', 'b6e5c80b-3dce-492d-972a-93ed8f25828f', 'dcf625cc-b4ab-48d8-b880-812139285b94'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 17:59:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 17:59:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 17:59:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 17:59:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 17:59:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 17:59:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 17:59:49 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 17:59:49 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 17:59:50 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Jul 07 17:59:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.717s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 17:59:50 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 17:59:50 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Deleted volume successfully. Jul 07 17:59:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-878b384d-db4c-4b7b-b348-027d0744a47a tempest-VolumesTestJSON-1561133942 None] Lock "cinder-49aff3d9-3866-4b37-972e-08ca42c0deed-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:01 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=16,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:00:01 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=18,cinder:SELECT=11,cinder:INSERT=3 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:00:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7bfe962d-3749-4c4a-a1f1-eb80c51172f5 tempest-BackendsCapabilitiesAdminTestsJSON-56716997 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710304260254, 'free_capacity_gb': 1775.710304260254, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86972) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 18:00:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2ee06e79-c0d7-4607-a39f-03cca54c0688 tempest-BackendsCapabilitiesAdminTestsJSON-56716997 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710304260254, 'free_capacity_gb': 1775.710304260254, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86972) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 18:00:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:00:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:12 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:00:12 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:13 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.959s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Flow 'volume_create_manager' (f5aa93a7-205d-4e95-90a1-1073a364410b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbb3d42-dd40-4d66-b7be-c5fcdd337391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbb3d42-dd40-4d66-b7be-c5fcdd337391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1307356033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862c6931-1e28-40f6-a448-842f62153799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0f4717b56244ff90df4122cae7479f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:17Z,use_quota=True,user_id='6539d48500f1415987aed493753d73b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb986baf-7917-43d8-924a-7f12f0217c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb986baf-7917-43d8-924a-7f12f0217c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166bdd62-d3fb-4952-aea7-93baf9d10b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166bdd62-d3fb-4952-aea7-93baf9d10b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '862c6931-1e28-40f6-a448-842f62153799', 'volume_name': 'volume-862c6931-1e28-40f6-a448-842f62153799', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6753da9c-8224-4a31-ac9a-bf9f72460b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6753da9c-8224-4a31-ac9a-bf9f72460b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb50622f-50ce-4ed9-9b9c-f41c8c1299a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:16 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Volume 862c6931-1e28-40f6-a448-842f62153799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-862c6931-1e28-40f6-a448-842f62153799', 'volume_size': 1} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1307356033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862c6931-1e28-40f6-a448-842f62153799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0f4717b56244ff90df4122cae7479f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:17Z,use_quota=True,user_id='6539d48500f1415987aed493753d73b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Creating volume 862c6931-1e28-40f6-a448-842f62153799 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:00:16 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:00:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:17 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 1073741824 Jul 07 18:00:17 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:18 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 1073741824" returned: 0 in 1.020s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:18 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 Jul 07 18:00:18 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:18 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799" returned: 0 in 0.776s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:00:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb50622f-50ce-4ed9-9b9c-f41c8c1299a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-862c6931-1e28-40f6-a448-842f62153799', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805f0a9f-0ad8-4d7a-bd71-4bfba968ef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:18 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Volume volume-862c6931-1e28-40f6-a448-842f62153799 (862c6931-1e28-40f6-a448-842f62153799): created successfully Jul 07 18:00:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805f0a9f-0ad8-4d7a-bd71-4bfba968ef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Flow 'volume_create_manager' (f5aa93a7-205d-4e95-90a1-1073a364410b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:18 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4e4c0d6a-52f5-47e4-a2f8-cf8585096c93 tempest-TaggedAttachmentsTest-498013944 None] Created volume successfully. Jul 07 18:00:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fbadfed3-5d6f-47da-bb4d-45d7acd027d0 tempest-GroupSnapshotsTest-1768541375 None] Group tempest-GroupSnapshotsTest-Group-1673600879: creating Jul 07 18:00:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fbadfed3-5d6f-47da-bb4d-45d7acd027d0 tempest-GroupSnapshotsTest-1768541375 None] Group tempest-GroupSnapshotsTest-Group-1673600879: created successfully Jul 07 18:00:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fbadfed3-5d6f-47da-bb4d-45d7acd027d0 tempest-GroupSnapshotsTest-1768541375 None] Create group completed successfully. Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Flow 'volume_create_manager' (92398a5a-0af1-4479-a104-cf4cfcc3c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd63ea9-73ea-4211-993c-d0b7eff005a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd63ea9-73ea-4211-993c-d0b7eff005a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1696488379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0774759e-08f2-43c4-8480-f4c85501c6e9,host='devstack@QuobyteHD#QuobyteHD',id=22a96070-2f1b-4360-8f93-2417b5fd435c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785659846caf455cb3c1449e4b715aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:21Z,use_quota=True,user_id='b91757c886d84ff0b96c7eee09049b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e5a205b-da83-4e59-8718-d5ba3643bc32),volume_type_id=8e5a205b-da83-4e59-8718-d5ba3643bc32)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bb3535-bc10-4198-8d56-4ec5093a38b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bb3535-bc10-4198-8d56-4ec5093a38b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c920edf0-c91f-4c7f-95f6-407e31e514f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c920edf0-c91f-4c7f-95f6-407e31e514f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a96070-2f1b-4360-8f93-2417b5fd435c', 'volume_name': 'volume-22a96070-2f1b-4360-8f93-2417b5fd435c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7134f5-f8b0-4a5c-8164-001392d63fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7134f5-f8b0-4a5c-8164-001392d63fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85a1989-eb78-4d95-9ae9-b423ee209ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:20 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Volume 22a96070-2f1b-4360-8f93-2417b5fd435c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a96070-2f1b-4360-8f93-2417b5fd435c', 'volume_size': 1} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0774759e-08f2-43c4-8480-f4c85501c6e9,created_at=2026-07-07T16:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1696488379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0774759e-08f2-43c4-8480-f4c85501c6e9,host='devstack@QuobyteHD#QuobyteHD',id=22a96070-2f1b-4360-8f93-2417b5fd435c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785659846caf455cb3c1449e4b715aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:21Z,use_quota=True,user_id='b91757c886d84ff0b96c7eee09049b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e5a205b-da83-4e59-8718-d5ba3643bc32),volume_type_id=8e5a205b-da83-4e59-8718-d5ba3643bc32)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Creating volume 22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:00:20 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:00:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:20 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c 1073741824 Jul 07 18:00:20 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:22 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c 1073741824" returned: 0 in 1.090s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:22 devstack sudo[89255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c Jul 07 18:00:22 devstack sudo[89255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:23 devstack sudo[89255]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c" returned: 0 in 0.949s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:00:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85a1989-eb78-4d95-9ae9-b423ee209ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a96070-2f1b-4360-8f93-2417b5fd435c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51f8b95-b0a9-4cb5-9ee2-a524ee29e8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:23 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Volume volume-22a96070-2f1b-4360-8f93-2417b5fd435c (22a96070-2f1b-4360-8f93-2417b5fd435c): created successfully Jul 07 18:00:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51f8b95-b0a9-4cb5-9ee2-a524ee29e8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Flow 'volume_create_manager' (92398a5a-0af1-4479-a104-cf4cfcc3c22c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-92c88f12-dba3-4609-87c8-1eb916d0664e tempest-GroupSnapshotsTest-1768541375 None] Created volume successfully. Jul 07 18:00:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] GroupSnapshot 6d19205c-4e59-40ad-a510-ea467c226423: creating. Jul 07 18:00:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Group snapshot 6d19205c-4e59-40ad-a510-ea467c226423: creating. {{(pid=86972) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 18:00:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Creating offline snapshot 12546460-06af-4e75-8881-a1fcd6079fb0 of volume 22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:00:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d1a29d-15fa-48b3-91eb-5bf197cb86a9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:24 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c Jul 07 18:00:24 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:25 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c" returned: 0 in 1.366s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:25 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 1G Jul 07 18:00:25 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:26 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 1G" returned: 0 in 1.308s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a96070-2f1b-4360-8f93-2417b5fd435c -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:26 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a96070-2f1b-4360-8f93-2417b5fd435c -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 Jul 07 18:00:26 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Flow 'volume_create_manager' (4fcb95c6-1fa2-4e30-8cf4-521fb90d5fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f04206a-3db8-4e0b-94c5-6b85dcb10ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f04206a-3db8-4e0b-94c5-6b85dcb10ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-734169290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb780109-b779-48ff-b8b5-17ae3e052193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a557a9b13841b9b7187f556537fdf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:27Z,use_quota=True,user_id='5f7b28551c7440f9848e4933c935f381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93aa322b-b064-4d86-9a53-bda4b7813af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93aa322b-b064-4d86-9a53-bda4b7813af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3334261-361d-4101-b296-a23666b94788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3334261-361d-4101-b296-a23666b94788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb780109-b779-48ff-b8b5-17ae3e052193', 'volume_name': 'volume-cb780109-b779-48ff-b8b5-17ae3e052193', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a183290-d045-45bc-aee3-d6acb1a6448a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a183290-d045-45bc-aee3-d6acb1a6448a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f733926-9f25-4abd-9c6a-c564b69a854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:27 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Volume cb780109-b779-48ff-b8b5-17ae3e052193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb780109-b779-48ff-b8b5-17ae3e052193', 'volume_size': 1} Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:27 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a96070-2f1b-4360-8f93-2417b5fd435c -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0" returned: 0 in 1.126s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:27 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:00:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:27 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 Jul 07 18:00:27 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:28 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0" returned: 0 in 0.680s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:28 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.info Jul 07 18:00:28 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:29 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.info" returned: 0 in 0.863s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:29 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:00:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:29 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.info Jul 07 18:00:29 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:30 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.info" returned: 0 in 0.910s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.418s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.969s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-734169290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb780109-b779-48ff-b8b5-17ae3e052193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a557a9b13841b9b7187f556537fdf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:00:27Z,use_quota=True,user_id='5f7b28551c7440f9848e4933c935f381',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Creating volume cb780109-b779-48ff-b8b5-17ae3e052193 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:00:30 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:00:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:30 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193 1073741824 Jul 07 18:00:30 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:30 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-65d03b9f-a337-4ce1-9200-271ae71057e1 tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 6d19205c-4e59-40ad-a510-ea467c226423: created successfully Jul 07 18:00:31 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193 1073741824" returned: 0 in 1.435s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:32 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193 Jul 07 18:00:32 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:33 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193" returned: 0 in 1.496s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] <== create_volume: return (3115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:00:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.123s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f733926-9f25-4abd-9c6a-c564b69a854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb780109-b779-48ff-b8b5-17ae3e052193', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105a3988-586f-4a84-8f11-33d075f79586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:00:33 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Volume volume-cb780109-b779-48ff-b8b5-17ae3e052193 (cb780109-b779-48ff-b8b5-17ae3e052193): created successfully Jul 07 18:00:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105a3988-586f-4a84-8f11-33d075f79586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:00:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Flow 'volume_create_manager' (4fcb95c6-1fa2-4e30-8cf4-521fb90d5fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:00:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-30b60bba-bc6f-4a25-a84c-71c69d1003fa tempest-VolumesAdminNegativeTest-1036657463 None] Created volume successfully. Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-12546460-06af-4e75-8881-a1fcd6079fb0-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" by "_create_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-12546460-06af-4e75-8881-a1fcd6079fb0-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Creating volume 58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 from snapshot 12546460-06af-4e75-8881-a1fcd6079fb0 {{(pid=86972) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] snapshot: 12546460-06af-4e75-8881-a1fcd6079fb0, volume: 58a020fa-6a3a-4ae4-8e4b-4ae71fd70896, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bade4b-6e96-43e0-8a5a-373c60583f57]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:34 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 Jul 07 18:00:34 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Acquiring lock "cinder-cb780109-b779-48ff-b8b5-17ae3e052193-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Lock "cinder-cb780109-b779-48ff-b8b5-17ae3e052193-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Acquiring lock "cinder-quobyte-cb780109-b779-48ff-b8b5-17ae3e052193" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Lock "cinder-quobyte-cb780109-b779-48ff-b8b5-17ae3e052193" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a111e95e-84b9-4b68-8287-b4aa52402c12]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:35 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193 Jul 07 18:00:35 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:35 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0" returned: 0 in 1.259s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22a96070-2f1b-4360-8f93-2417b5fd435c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:00:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:00:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:00:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4150fee-49e0-4e91-8d99-2ae4312fe589]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:35 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c Jul 07 18:00:35 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:36 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193" returned: 0 in 1.324s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:36 devstack sudo[89376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193 Jul 07 18:00:36 devstack sudo[89376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:36 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c" returned: 0 in 1.106s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:36 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:00:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:36 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 Jul 07 18:00:36 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:37 devstack sudo[89376]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb780109-b779-48ff-b8b5-17ae3e052193" returned: 0 in 0.812s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Lock "cinder-quobyte-cb780109-b779-48ff-b8b5-17ae3e052193" released by "delete_volume" :: held 2.188s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:37 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Created reservations ['9bcd6728-f226-4bf9-8f85-eb9a001ffb43', 'cbee8eff-41e2-49e2-b959-ec70652cc906', 'cd74bff9-73d1-49e7-a8b2-b952247697e7', 'a67d4ffc-db42-45ff-b8e1-576d98865c57'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:00:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:37 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:00:37 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:39 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.872s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:39 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:00:39 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Deleted volume successfully. Jul 07 18:00:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a5b5bec-be7e-4573-a762-7418f6723d11 tempest-VolumesAdminNegativeTest-1036657463 None] Lock "cinder-cb780109-b779-48ff-b8b5-17ae3e052193-delete_volume" released by "delete_volume" :: held 4.447s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:44 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" returned: 0 in 8.362s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:45 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76f2eba-aad4-4348-a9a7-01a9f5c4f93e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:45 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c Jul 07 18:00:45 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:46 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c" returned: 0 in 1.807s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:46 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:00:46 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Converted 1024.00 MB image at 122.45 MB/s Jul 07 18:00:46 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:00:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:46 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 Jul 07 18:00:46 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:47 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=25,cinder:INSERT=3,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:00:47 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" returned: 0 in 0.896s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" released by "_copy_volume_from_snapshot" :: held 13.580s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-12546460-06af-4e75-8881-a1fcd6079fb0-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" released by "_create_volume_from_snapshot" :: held 13.627s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.653s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:47 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b74c1c32-9424-4f1e-af75-23d63c5936bc tempest-GroupSnapshotsTest-1768541375 None] Create group from source-snapshot-6d19205c-4e59-40ad-a510-ea467c226423 completed successfully. Jul 07 18:00:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:49 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d85b63-e7fa-438a-a8c2-99196d8622a5]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:49 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 Jul 07 18:00:49 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:50 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" returned: 0 in 0.936s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:50 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896 Jul 07 18:00:50 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:51 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" returned: 0 in 0.993s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-58a020fa-6a3a-4ae4-8e4b-4ae71fd70896" released by "delete_volume" :: held 2.005s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:51 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['7bc8acfc-5c39-45e1-b975-2f0dc7b496a3'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:00:52 devstack cinder-volume[86972]: WARNING cinder.quota [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-341259245 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-341259245, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:00:52 devstack cinder-volume[86972]: WARNING cinder.quota [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-341259245 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-341259245, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['abc6036b-b827-40aa-9f82-b272af49cf9e', 'cd7f1b94-d0b2-4287-b8ae-929dfe8da545', '656279bf-f417-429d-815d-3d3e58ee6cd4', 'ad971e6c-1c43-41e6-a1c6-a061d60b751c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:52 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:00:52 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 6d19205c-4e59-40ad-a510-ea467c226423: deleting Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 6d19205c-4e59-40ad-a510-ea467c226423: deleting {{(pid=86972) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-22a96070-2f1b-4360-8f93-2417b5fd435c" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-22a96070-2f1b-4360-8f93-2417b5fd435c" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-12546460-06af-4e75-8881-a1fcd6079fb0" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-12546460-06af-4e75-8881-a1fcd6079fb0" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Deleting offline snapshot 12546460-06af-4e75-8881-a1fcd6079fb0 of volume 22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] snapshot_file for this snap is: volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba8a1b8-b17b-480e-865c-eca084676e3b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:53 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 Jul 07 18:00:53 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:53 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.463s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:53 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:00:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-20bc8afe-4246-4bc8-bf0e-1ab298f7fbee tempest-GroupSnapshotsTest-1768541375 None] Delete group completed successfully. Jul 07 18:00:54 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0" returned: 0 in 1.313s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22a96070-2f1b-4360-8f93-2417b5fd435c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:00:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7c9ad8-83d0-4124-97a4-7d74a7b3e338]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:54 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c Jul 07 18:00:54 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:55 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c" returned: 0 in 1.026s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:55 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 Jul 07 18:00:55 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:56 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0" returned: 0 in 0.970s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:56 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0 Jul 07 18:00:56 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:00:57 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Jul 07 18:00:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c.12546460-06af-4e75-8881-a1fcd6079fb0" returned: 0 in 1.158s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:00:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-12546460-06af-4e75-8881-a1fcd6079fb0" released by "_delete_snapshot" :: held 4.687s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-22a96070-2f1b-4360-8f93-2417b5fd435c" released by "delete_snapshot" :: held 4.751s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:00:57 devstack cinder-volume[86972]: WARNING cinder.quota [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-341259245 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-341259245, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:00:57 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['10455b38-8347-4b6e-a7cb-4d8b636e1860', 'db653187-128d-487a-94d2-74fd59aad468', '92cd3d08-dafb-46fc-b55c-ad1ddf0c778b', '6ea1458a-cc77-4f7d-9297-ff28588067d2'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:00:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0bcefda7-2aab-474a-92e4-0d79b6c30e23 tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 6d19205c-4e59-40ad-a510-ea467c226423: deleted successfully Jul 07 18:00:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-22a96070-2f1b-4360-8f93-2417b5fd435c" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:00:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-22a96070-2f1b-4360-8f93-2417b5fd435c" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:00:59 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[373ae0ab-7edb-4ac2-a09a-cbdf09101302]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:00:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:00:59 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c Jul 07 18:00:59 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:00 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c" returned: 0 in 0.939s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:00 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c Jul 07 18:01:00 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:01 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22a96070-2f1b-4360-8f93-2417b5fd435c" returned: 0 in 0.929s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-22a96070-2f1b-4360-8f93-2417b5fd435c" released by "delete_volume" :: held 1.973s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['9391a874-b63a-45bd-a41b-3dd3f59a2f13'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:01 devstack cinder-volume[86972]: WARNING cinder.db.api [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-341259245'] Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['e8737892-c6e6-4db8-94d6-f533cb852177', '195af051-6a1d-4bb2-a629-959750285c8f', '318deb20-0cb6-48bf-a409-4ec38cc2cc2b', 'fb349211-bced-4a9f-9856-52d87d92f0a1'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:01 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:01:01 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:02 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.745s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:02 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:02 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8502f4a8-a245-45c4-8366-d03be429d884 tempest-GroupSnapshotsTest-1768541375 None] Delete group completed successfully. Jul 07 18:01:02 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-70eb27f2-31a2-4e38-8cf2-cf6b76d204e2 tempest-GroupSnapshotsTest-1768541375 None] Group tempest-GroupSnapshotsTest-Group-987927723: creating Jul 07 18:01:02 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-70eb27f2-31a2-4e38-8cf2-cf6b76d204e2 tempest-GroupSnapshotsTest-1768541375 None] Group tempest-GroupSnapshotsTest-Group-987927723: created successfully Jul 07 18:01:02 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-70eb27f2-31a2-4e38-8cf2-cf6b76d204e2 tempest-GroupSnapshotsTest-1768541375 None] Create group completed successfully. Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Flow 'volume_create_manager' (556cf9f1-814b-41b4-9673-aa3948111d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d1f487-90f8-49e1-aaa8-1a6b6425e976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d1f487-90f8-49e1-aaa8-1a6b6425e976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1710306933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23978de9-ba1c-4394-8cc1-b40696508a21,host='devstack@QuobyteHD#QuobyteHD',id=c8252592-421a-48ba-9aa8-c9638f595b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785659846caf455cb3c1449e4b715aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:04Z,use_quota=True,user_id='b91757c886d84ff0b96c7eee09049b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da757dac-9a41-4eb8-bda4-048ead9ac0b0),volume_type_id=da757dac-9a41-4eb8-bda4-048ead9ac0b0)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b155030-9fa4-43d3-81f9-a09f890f45c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b155030-9fa4-43d3-81f9-a09f890f45c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f3f6cf-b7d5-4de7-8fe8-98aa75c663f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f3f6cf-b7d5-4de7-8fe8-98aa75c663f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8252592-421a-48ba-9aa8-c9638f595b01', 'volume_name': 'volume-c8252592-421a-48ba-9aa8-c9638f595b01', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fdb9d4-018b-4ecb-b839-423e06e135bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40fdb9d4-018b-4ecb-b839-423e06e135bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836e3658-555d-4689-b7c9-c12274ccd94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:04 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Volume c8252592-421a-48ba-9aa8-c9638f595b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8252592-421a-48ba-9aa8-c9638f595b01', 'volume_size': 1} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23978de9-ba1c-4394-8cc1-b40696508a21,created_at=2026-07-07T16:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1710306933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23978de9-ba1c-4394-8cc1-b40696508a21,host='devstack@QuobyteHD#QuobyteHD',id=c8252592-421a-48ba-9aa8-c9638f595b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785659846caf455cb3c1449e4b715aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:04Z,use_quota=True,user_id='b91757c886d84ff0b96c7eee09049b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da757dac-9a41-4eb8-bda4-048ead9ac0b0),volume_type_id=da757dac-9a41-4eb8-bda4-048ead9ac0b0)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Creating volume c8252592-421a-48ba-9aa8-c9638f595b01 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:04 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:01:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:04 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 1073741824 Jul 07 18:01:04 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:05 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 1073741824" returned: 0 in 0.891s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:05 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 Jul 07 18:01:05 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:06 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01" returned: 0 in 0.833s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836e3658-555d-4689-b7c9-c12274ccd94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8252592-421a-48ba-9aa8-c9638f595b01', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf60ecc-2812-40c2-965c-f6a2643b6573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Volume volume-c8252592-421a-48ba-9aa8-c9638f595b01 (c8252592-421a-48ba-9aa8-c9638f595b01): created successfully Jul 07 18:01:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf60ecc-2812-40c2-965c-f6a2643b6573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Flow 'volume_create_manager' (556cf9f1-814b-41b4-9673-aa3948111d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-66ff81b7-fa6f-435c-83e8-cbc74c61f9fc tempest-GroupSnapshotsTest-1768541375 None] Created volume successfully. Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Flow 'volume_create_manager' (019e514d-ad12-43e2-b71b-c15a67f595a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec0bb2c-01cd-4041-8e72-173647bc6b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec0bb2c-01cd-4041-8e72-173647bc6b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589454109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23978de9-ba1c-4394-8cc1-b40696508a21,host='devstack@QuobyteHD#QuobyteHD',id=46ff2207-08b2-4ca8-b394-d2c02a0bb4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785659846caf455cb3c1449e4b715aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:08Z,use_quota=True,user_id='b91757c886d84ff0b96c7eee09049b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da757dac-9a41-4eb8-bda4-048ead9ac0b0),volume_type_id=da757dac-9a41-4eb8-bda4-048ead9ac0b0)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2c71af-ea80-4a51-b9e3-bb3859e6e4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2c71af-ea80-4a51-b9e3-bb3859e6e4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a57e146-c660-4d12-87ba-aebaa4b7c9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a57e146-c660-4d12-87ba-aebaa4b7c9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ff2207-08b2-4ca8-b394-d2c02a0bb4d2', 'volume_name': 'volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5576b7ee-16ae-47dc-a01c-85e0fdf4f122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5576b7ee-16ae-47dc-a01c-85e0fdf4f122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43552e8-258f-493c-a747-a92de0c3a0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:07 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Volume 46ff2207-08b2-4ca8-b394-d2c02a0bb4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2', 'volume_size': 1} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23978de9-ba1c-4394-8cc1-b40696508a21,created_at=2026-07-07T16:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589454109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23978de9-ba1c-4394-8cc1-b40696508a21,host='devstack@QuobyteHD#QuobyteHD',id=46ff2207-08b2-4ca8-b394-d2c02a0bb4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785659846caf455cb3c1449e4b715aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:08Z,use_quota=True,user_id='b91757c886d84ff0b96c7eee09049b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da757dac-9a41-4eb8-bda4-048ead9ac0b0),volume_type_id=da757dac-9a41-4eb8-bda4-048ead9ac0b0)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Creating volume 46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:07 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:01:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:07 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 1073741824 Jul 07 18:01:07 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:08 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 1073741824" returned: 0 in 0.900s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:08 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 Jul 07 18:01:08 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:09 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" returned: 0 in 0.636s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b43552e8-258f-493c-a747-a92de0c3a0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e248dc-7a76-49e9-8554-20e8b3e6ecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:09 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Volume volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 (46ff2207-08b2-4ca8-b394-d2c02a0bb4d2): created successfully Jul 07 18:01:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e248dc-7a76-49e9-8554-20e8b3e6ecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Flow 'volume_create_manager' (019e514d-ad12-43e2-b71b-c15a67f595a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:09 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-785a1da7-ca2a-4214-a7a4-b56312f151be tempest-GroupSnapshotsTest-1768541375 None] Created volume successfully. Jul 07 18:01:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8c06f044-e494-4b40-8efe-b84a2175cd43 tempest-GroupSnapshotsTest-1768541375 None] Update group completed successfully. Jul 07 18:01:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a945f9ef-100b-4d9c-8455-d4372ca42a2b tempest-GroupSnapshotsTest-1768541375 None] Update group completed successfully. Jul 07 18:01:12 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=51,cinder:SELECT=53,cinder:DELETE=5,cinder:INSERT=14 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:01:12 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-99b6afa2-9cf8-4ea0-b8ea-64a3f6107d0e tempest-GroupSnapshotsTest-1768541375 None] Update group completed successfully. Jul 07 18:01:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:01:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:12 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:01:12 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:13 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.044s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:01:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 8 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:01:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:01:14 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-04e60bee-c365-4f0d-8ed7-2d21d467e572 tempest-GroupSnapshotsTest-1768541375 None] Update group completed successfully. Jul 07 18:01:16 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] GroupSnapshot 85225b69-6741-4060-8015-f301a6d9db57: creating. Jul 07 18:01:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Group snapshot 85225b69-6741-4060-8015-f301a6d9db57: creating. {{(pid=86972) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 18:01:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Creating offline snapshot 753dba83-0804-497d-9492-88b08139006d of volume c8252592-421a-48ba-9aa8-c9638f595b01 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:16 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bf5d21-4161-4c31-9ff4-0ebf37bb9c55]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:16 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 Jul 07 18:01:16 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:17 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01" returned: 0 in 1.028s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:17 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d 1G Jul 07 18:01:17 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:18 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d 1G" returned: 0 in 0.867s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8252592-421a-48ba-9aa8-c9638f595b01 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:18 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8252592-421a-48ba-9aa8-c9638f595b01 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d Jul 07 18:01:18 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:18 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8252592-421a-48ba-9aa8-c9638f595b01 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d" returned: 0 in 0.782s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:18 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:01:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:18 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d Jul 07 18:01:18 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:19 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d" returned: 0 in 0.757s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:19 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.info Jul 07 18:01:19 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:19 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Flow 'volume_create_manager' (b8bef76f-5704-4ed3-9dc1-507528e4f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc2de0c-8f12-4b7a-990e-d3e4031811f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc2de0c-8f12-4b7a-990e-d3e4031811f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-562964082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa3401d-b68c-4d44-9089-a4867fb5109a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abb6911430648a4b162a9a78a5ca28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:20Z,use_quota=True,user_id='219a51d2dfed4593b6e4deeb057f1a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e9c78e-cd8b-4566-ba1f-631df825f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e9c78e-cd8b-4566-ba1f-631df825f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9ae0e4-a080-4e82-8c2b-119b5f642951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9ae0e4-a080-4e82-8c2b-119b5f642951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa3401d-b68c-4d44-9089-a4867fb5109a', 'volume_name': 'volume-afa3401d-b68c-4d44-9089-a4867fb5109a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d527674-f247-4d5d-a98b-43f282fdcb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d527674-f247-4d5d-a98b-43f282fdcb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59c3a49-0734-489e-aef9-ecedda9dc7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:20 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Volume afa3401d-b68c-4d44-9089-a4867fb5109a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa3401d-b68c-4d44-9089-a4867fb5109a', 'volume_size': 1} Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:20 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.info" returned: 0 in 0.779s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:20 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:01:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:20 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.info Jul 07 18:01:20 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:21 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.info" returned: 0 in 0.845s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.253s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Creating offline snapshot 78e6eacf-44c5-4df8-a01c-1145ec5b7313 of volume 46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ba677e-caa5-4d68-8752-43ef62e0201d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:21 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 Jul 07 18:01:21 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:22 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" returned: 0 in 0.790s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:22 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 1G Jul 07 18:01:22 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:23 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 1G" returned: 0 in 0.948s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:23 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 Jul 07 18:01:23 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-ebaa94dc-9e26-41be-93d6-8c96f4bc2fa0 req-b1d3ff0c-7d20-4571-94fa-c49fd8302784 tempest-TaggedAttachmentsTest-498013944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:23 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313" returned: 0 in 0.711s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:23 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:01:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:23 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 Jul 07 18:01:23 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:24 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313" returned: 0 in 0.654s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:24 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.info Jul 07 18:01:24 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:25 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.info" returned: 0 in 0.688s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:25 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:25 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.info Jul 07 18:01:25 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:25 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.info" returned: 0 in 0.681s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.560s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.883s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-562964082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa3401d-b68c-4d44-9089-a4867fb5109a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abb6911430648a4b162a9a78a5ca28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:20Z,use_quota=True,user_id='219a51d2dfed4593b6e4deeb057f1a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Creating volume afa3401d-b68c-4d44-9089-a4867fb5109a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:25 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:01:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:25 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a 1073741824 Jul 07 18:01:25 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1a01b0c1-0b5b-4df9-9b62-fbf8f45f4c06 tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 85225b69-6741-4060-8015-f301a6d9db57: created successfully Jul 07 18:01:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 85225b69-6741-4060-8015-f301a6d9db57: deleting Jul 07 18:01:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 85225b69-6741-4060-8015-f301a6d9db57: deleting {{(pid=86972) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 18:01:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-c8252592-421a-48ba-9aa8-c9638f595b01" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:26 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a 1073741824" returned: 0 in 0.984s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-c8252592-421a-48ba-9aa8-c9638f595b01" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-753dba83-0804-497d-9492-88b08139006d" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-753dba83-0804-497d-9492-88b08139006d" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Deleting offline snapshot 753dba83-0804-497d-9492-88b08139006d of volume c8252592-421a-48ba-9aa8-c9638f595b01 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] snapshot_file for this snap is: volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1d1e95-70b8-42c8-8148-4d665fea6f54]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:27 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a Jul 07 18:01:27 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:27 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d Jul 07 18:01:27 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:27 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a" returned: 0 in 0.736s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-ebaa94dc-9e26-41be-93d6-8c96f4bc2fa0 req-b1d3ff0c-7d20-4571-94fa-c49fd8302784 tempest-TaggedAttachmentsTest-498013944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.500s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59c3a49-0734-489e-aef9-ecedda9dc7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa3401d-b68c-4d44-9089-a4867fb5109a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdae12c-5681-4a0d-9cee-1505ce27b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[52002bc0-77b2-4f33-be42-7975c71d9800]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-ebaa94dc-9e26-41be-93d6-8c96f4bc2fa0 req-b1d3ff0c-7d20-4571-94fa-c49fd8302784 tempest-TaggedAttachmentsTest-498013944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:27 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Volume volume-afa3401d-b68c-4d44-9089-a4867fb5109a (afa3401d-b68c-4d44-9089-a4867fb5109a): created successfully Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccdae12c-5681-4a0d-9cee-1505ce27b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Flow 'volume_create_manager' (b8bef76f-5704-4ed3-9dc1-507528e4f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-905ac3e6-f63e-40a9-aec7-d4fc80905580 tempest-AttachVolumeTestJSON-910217716 None] Created volume successfully. Jul 07 18:01:27 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d" returned: 0 in 0.824s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8252592-421a-48ba-9aa8-c9638f595b01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:27 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 Jul 07 18:01:27 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf86ce5-0f3b-4ddb-b46a-a957676c0801]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:28 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 Jul 07 18:01:28 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:28 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-ebaa94dc-9e26-41be-93d6-8c96f4bc2fa0 req-b1d3ff0c-7d20-4571-94fa-c49fd8302784 tempest-TaggedAttachmentsTest-498013944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799" returned: 0 in 0.788s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-ebaa94dc-9e26-41be-93d6-8c96f4bc2fa0 req-b1d3ff0c-7d20-4571-94fa-c49fd8302784 tempest-TaggedAttachmentsTest-498013944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-ebaa94dc-9e26-41be-93d6-8c96f4bc2fa0 req-b1d3ff0c-7d20-4571-94fa-c49fd8302784 tempest-TaggedAttachmentsTest-498013944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-862c6931-1e28-40f6-a448-842f62153799', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac8fd359-0c69-4486-a431-9bdec312bdf7', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:01:28 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-ebaa94dc-9e26-41be-93d6-8c96f4bc2fa0 req-b1d3ff0c-7d20-4571-94fa-c49fd8302784 tempest-TaggedAttachmentsTest-498013944 None] attachment_update completed successfully. Jul 07 18:01:28 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01" returned: 0 in 0.861s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:28 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d Jul 07 18:01:28 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:29 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d" returned: 0 in 0.827s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:29 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d Jul 07 18:01:29 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:30 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01.753dba83-0804-497d-9492-88b08139006d" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-753dba83-0804-497d-9492-88b08139006d" released by "_delete_snapshot" :: held 3.330s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-c8252592-421a-48ba-9aa8-c9638f595b01" released by "delete_snapshot" :: held 3.375s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-78e6eacf-44c5-4df8-a01c-1145ec5b7313" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-78e6eacf-44c5-4df8-a01c-1145ec5b7313" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Deleting offline snapshot 78e6eacf-44c5-4df8-a01c-1145ec5b7313 of volume 46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] snapshot_file for this snap is: volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c93f504-73ab-47b0-b8ed-d752300ef487]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:30 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 Jul 07 18:01:30 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:31 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313" returned: 0 in 0.960s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:31 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8b7bd7-be0f-4165-a42b-2c973a3f2ebe]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:31 devstack sudo[90364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 Jul 07 18:01:31 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-980e10e2-88ea-461d-ad1a-f842cd55bee4 req-1c23badd-51b6-4237-baca-129b2e113bc3 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-980e10e2-88ea-461d-ad1a-f842cd55bee4 req-1c23badd-51b6-4237-baca-129b2e113bc3 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:31 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1527ec01-8189-40a6-b9fe-e6ebf8ab1a9c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-980e10e2-88ea-461d-ad1a-f842cd55bee4 req-1c23badd-51b6-4237-baca-129b2e113bc3 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:32 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a Jul 07 18:01:32 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:32 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" returned: 0 in 1.032s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:32 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 Jul 07 18:01:32 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:32 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-980e10e2-88ea-461d-ad1a-f842cd55bee4 req-1c23badd-51b6-4237-baca-129b2e113bc3 tempest-AttachVolumeTestJSON-910217716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a" returned: 0 in 0.959s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-980e10e2-88ea-461d-ad1a-f842cd55bee4 req-1c23badd-51b6-4237-baca-129b2e113bc3 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-980e10e2-88ea-461d-ad1a-f842cd55bee4 req-1c23badd-51b6-4237-baca-129b2e113bc3 tempest-AttachVolumeTestJSON-910217716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-afa3401d-b68c-4d44-9089-a4867fb5109a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee9bd3f7-5e01-4a39-9d39-9b0acfe25c41', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:01:32 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-980e10e2-88ea-461d-ad1a-f842cd55bee4 req-1c23badd-51b6-4237-baca-129b2e113bc3 tempest-AttachVolumeTestJSON-910217716 None] attachment_update completed successfully. Jul 07 18:01:33 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313" returned: 0 in 0.830s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:33 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313 Jul 07 18:01:33 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:34 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2.78e6eacf-44c5-4df8-a01c-1145ec5b7313" returned: 0 in 0.680s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-78e6eacf-44c5-4df8-a01c-1145ec5b7313" released by "_delete_snapshot" :: held 3.661s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" released by "delete_snapshot" :: held 3.684s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:34 devstack cinder-volume[86972]: WARNING cinder.quota [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-917371543 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-917371543, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:01:34 devstack cinder-volume[86972]: WARNING cinder.quota [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-917371543 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-917371543, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:01:34 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['c58a32d5-1e5f-4a7f-a8a5-79238ee81b22', 'daad09ce-e482-4bcb-9e59-091de2e0ff83', '780cd260-cee3-4dd6-b898-a6c751dcdcbe', '9c5fcb8f-da74-4da4-a004-f4e804062c31'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:34 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['8861f535-726c-4789-b45e-d0bcc908237c', '448ab80d-8da9-460a-bf54-ad83dff19df9', '94ec2f79-c638-4343-84e4-df77832535dc', 'b763a920-b94c-4ffb-8a0d-7088ce8fcc72'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:34 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-28ea658d-b616-4758-ad2c-0c079379478b tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 85225b69-6741-4060-8015-f301a6d9db57: deleted successfully Jul 07 18:01:34 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-055b5871-ec17-4c5a-8d83-f22957cc443f req-bbf3529b-3779-4b0f-bcb1-37289149c709 tempest-TaggedAttachmentsTest-498013944 None] Terminate volume connection completed successfully. Jul 07 18:01:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-055b5871-ec17-4c5a-8d83-f22957cc443f req-bbf3529b-3779-4b0f-bcb1-37289149c709 tempest-TaggedAttachmentsTest-498013944 None] Deleting attachment ac8fd359-0c69-4486-a431-9bdec312bdf7. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:01:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e9387e-7ec6-4bb4-97d9-d261da0a8ff1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:35 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 Jul 07 18:01:35 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:36 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" returned: 0 in 1.355s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:36 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2 Jul 07 18:01:36 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:37 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" returned: 0 in 0.758s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-46ff2207-08b2-4ca8-b394-d2c02a0bb4d2" released by "delete_volume" :: held 2.203s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-c8252592-421a-48ba-9aa8-c9638f595b01" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-c8252592-421a-48ba-9aa8-c9638f595b01" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:37 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc7414-d7c9-4c2c-b95c-ab028a9bb046]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:37 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 Jul 07 18:01:37 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:38 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01" returned: 0 in 1.348s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:38 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01 Jul 07 18:01:38 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:39 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c8252592-421a-48ba-9aa8-c9638f595b01" returned: 0 in 0.974s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-c8252592-421a-48ba-9aa8-c9638f595b01" released by "delete_volume" :: held 2.386s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:39 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['c2a4dd14-5038-4f26-83d4-9464737eef7c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:39 devstack cinder-volume[86972]: WARNING cinder.quota [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-917371543 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-917371543, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:01:39 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['4aba4f62-0499-4e65-b80d-7dcec42783fb', '03df43d0-e288-43bc-bc17-a84dbb78b141', 'd09e4827-0a1d-4cd2-9b23-9941e0be6f6f', '4fd4694d-7a61-4d0d-b09a-2f8ab131388a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:39 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['7767e191-bf0f-4fe2-b8d5-4b991aea9f8c', 'ce1868ec-8f93-441c-ba4d-62a795d0bdb1', '0fcd747f-2cfd-44b8-8325-df188630c7aa', '83dfda80-b417-4a86-8854-349015e56181'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:40 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:01:40 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c3e2c5f1-b041-4b04-9c50-b285b62e4dde tempest-GroupSnapshotsTest-1768541375 None] Group tempest-GroupSnapshotsTest-Group-878402486: creating Jul 07 18:01:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c3e2c5f1-b041-4b04-9c50-b285b62e4dde tempest-GroupSnapshotsTest-1768541375 None] Group tempest-GroupSnapshotsTest-Group-878402486: created successfully Jul 07 18:01:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c3e2c5f1-b041-4b04-9c50-b285b62e4dde tempest-GroupSnapshotsTest-1768541375 None] Create group completed successfully. Jul 07 18:01:41 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.129s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:41 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:41 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b3b5d207-12a5-4592-abe0-cc7f96f4f98a tempest-GroupSnapshotsTest-1768541375 None] Delete group completed successfully. Jul 07 18:01:42 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:01:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Flow 'volume_create_manager' (7ba2e640-3f93-4b9d-a2d3-5dffc35aeaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd3f4bd-ff44-4767-bd24-4b9b26e3ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd3f4bd-ff44-4767-bd24-4b9b26e3ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-678830553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ff7b83a-045f-4a95-a489-eb597ec2b81b,host='devstack@QuobyteHD#QuobyteHD',id=d49948c3-3151-46bb-9894-0d768153fe7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785659846caf455cb3c1449e4b715aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:43Z,use_quota=True,user_id='b91757c886d84ff0b96c7eee09049b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87f7d3b8-9a7c-4a98-9f3a-ea8a8a84957c),volume_type_id=87f7d3b8-9a7c-4a98-9f3a-ea8a8a84957c)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b338578-21f1-49fb-a332-e0deb2b83e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b338578-21f1-49fb-a332-e0deb2b83e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8716e4f8-4a22-4b6f-8f1b-705573969297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8716e4f8-4a22-4b6f-8f1b-705573969297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49948c3-3151-46bb-9894-0d768153fe7d', 'volume_name': 'volume-d49948c3-3151-46bb-9894-0d768153fe7d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8067d0a-8805-47b2-9204-5491c529988b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8067d0a-8805-47b2-9204-5491c529988b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e26436a-63ed-4717-a58a-0b820ef2e3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:43 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Volume d49948c3-3151-46bb-9894-0d768153fe7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49948c3-3151-46bb-9894-0d768153fe7d', 'volume_size': 1} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3ff7b83a-045f-4a95-a489-eb597ec2b81b,created_at=2026-07-07T16:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-678830553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3ff7b83a-045f-4a95-a489-eb597ec2b81b,host='devstack@QuobyteHD#QuobyteHD',id=d49948c3-3151-46bb-9894-0d768153fe7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='785659846caf455cb3c1449e4b715aef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:01:43Z,use_quota=True,user_id='b91757c886d84ff0b96c7eee09049b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87f7d3b8-9a7c-4a98-9f3a-ea8a8a84957c),volume_type_id=87f7d3b8-9a7c-4a98-9f3a-ea8a8a84957c)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Creating volume d49948c3-3151-46bb-9894-0d768153fe7d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:01:43 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:01:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:43 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d 1073741824 Jul 07 18:01:43 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:44 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d 1073741824" returned: 0 in 1.086s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:44 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d Jul 07 18:01:44 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:45 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d" returned: 0 in 0.969s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e26436a-63ed-4717-a58a-0b820ef2e3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49948c3-3151-46bb-9894-0d768153fe7d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5176e73c-aa9f-48ce-9779-77d6f3aed740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:01:45 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Volume volume-d49948c3-3151-46bb-9894-0d768153fe7d (d49948c3-3151-46bb-9894-0d768153fe7d): created successfully Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5176e73c-aa9f-48ce-9779-77d6f3aed740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Flow 'volume_create_manager' (7ba2e640-3f93-4b9d-a2d3-5dffc35aeaf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:01:45 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c18cf335-fc17-40d5-83ab-f98d5e0ef8c1 tempest-GroupSnapshotsTest-1768541375 None] Created volume successfully. Jul 07 18:01:45 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] GroupSnapshot 1ba9349e-a7bc-4ddf-9a5d-376adb076dff: creating. Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Group snapshot 1ba9349e-a7bc-4ddf-9a5d-376adb076dff: creating. {{(pid=86972) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Creating offline snapshot 07e6d019-7412-4b4e-98f1-1c0badd2933d of volume d49948c3-3151-46bb-9894-0d768153fe7d {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b87f923-5940-4a5c-9275-be1c1cbeded7]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:45 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d Jul 07 18:01:45 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:47 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d" returned: 0 in 1.193s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:47 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d 1G Jul 07 18:01:47 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:48 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d 1G" returned: 0 in 1.193s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49948c3-3151-46bb-9894-0d768153fe7d -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:48 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49948c3-3151-46bb-9894-0d768153fe7d -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d Jul 07 18:01:48 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:49 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49948c3-3151-46bb-9894-0d768153fe7d -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d" returned: 0 in 0.977s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:49 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:01:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:49 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d Jul 07 18:01:49 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:50 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d" returned: 0 in 0.937s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:50 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=82,cinder:SELECT=97,cinder:INSERT=17,cinder:DELETE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:01:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:50 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.info Jul 07 18:01:50 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:50 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.info" returned: 0 in 0.770s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:50 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:01:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:51 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.info Jul 07 18:01:51 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:51 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.info" returned: 0 in 0.760s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.923s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6462b7ff-c939-4fd5-ab35-06bfe3f535cb tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 1ba9349e-a7bc-4ddf-9a5d-376adb076dff: created successfully Jul 07 18:01:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 1ba9349e-a7bc-4ddf-9a5d-376adb076dff: deleting Jul 07 18:01:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 1ba9349e-a7bc-4ddf-9a5d-376adb076dff: deleting {{(pid=86972) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 18:01:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-d49948c3-3151-46bb-9894-0d768153fe7d" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-d49948c3-3151-46bb-9894-0d768153fe7d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-07e6d019-7412-4b4e-98f1-1c0badd2933d" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-07e6d019-7412-4b4e-98f1-1c0badd2933d" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Deleting offline snapshot 07e6d019-7412-4b4e-98f1-1c0badd2933d of volume d49948c3-3151-46bb-9894-0d768153fe7d {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:01:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] snapshot_file for this snap is: volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:01:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed01f99-6c63-48c3-b079-80840a5a2948]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:53 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d Jul 07 18:01:53 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:53 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d" returned: 0 in 0.997s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49948c3-3151-46bb-9894-0d768153fe7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:01:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0497dc7a-8f93-446a-8384-255f039558b1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:54 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d Jul 07 18:01:54 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:55 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d" returned: 0 in 1.124s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:55 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d Jul 07 18:01:55 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Acquiring lock "cinder-862c6931-1e28-40f6-a448-842f62153799-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Lock "cinder-862c6931-1e28-40f6-a448-842f62153799-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Acquiring lock "cinder-quobyte-862c6931-1e28-40f6-a448-842f62153799" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Lock "cinder-quobyte-862c6931-1e28-40f6-a448-842f62153799" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:55 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0616e622-ee4e-4d0b-b279-76e5a197b801]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:56 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 Jul 07 18:01:56 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:56 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d" returned: 0 in 1.102s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:56 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d Jul 07 18:01:56 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:56 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799" returned: 0 in 0.816s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:56 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799 Jul 07 18:01:56 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:56 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d.07e6d019-7412-4b4e-98f1-1c0badd2933d" returned: 0 in 0.715s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-07e6d019-7412-4b4e-98f1-1c0badd2933d" released by "_delete_snapshot" :: held 4.102s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-d49948c3-3151-46bb-9894-0d768153fe7d" released by "delete_snapshot" :: held 4.160s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:56 devstack cinder-volume[86972]: WARNING cinder.quota [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1135432117 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1135432117, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:01:56 devstack cinder-volume[86972]: WARNING cinder.quota [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1135432117 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1135432117, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['2b2fcd6a-681a-455b-8307-50670698e2c2', '63880a66-fbaa-4c42-b682-e3de74bbfe33', '802b1cd8-66fa-48ca-9883-05f05fa60f12', '83af659d-8cce-45c1-8aab-736eb2785ef7'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3461cb52-7407-43e5-a590-6c948d140161 tempest-GroupSnapshotsTest-1768541375 None] group_snapshot 1ba9349e-a7bc-4ddf-9a5d-376adb076dff: deleted successfully Jul 07 18:01:57 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-862c6931-1e28-40f6-a448-842f62153799" returned: 0 in 0.682s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Lock "cinder-quobyte-862c6931-1e28-40f6-a448-842f62153799" released by "delete_volume" :: held 1.551s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Created reservations ['58d86276-8bb0-4810-b394-9aff1a44e496', 'e46d98d5-7378-4de9-938d-22ef7b4127aa', 'ed985d52-04de-417e-8a25-748a8f3ce308', '4f91d348-042a-43ba-8a3b-b4a66c63fa65'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "cinder-quobyte-d49948c3-3151-46bb-9894-0d768153fe7d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-d49948c3-3151-46bb-9894-0d768153fe7d" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b68879-3bcc-4111-be14-e9d4619b5473]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:57 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:01:57 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:57 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d Jul 07 18:01:57 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:58 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.695s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:58 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:01:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Deleted volume successfully. Jul 07 18:01:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-69e80d27-cdad-4440-abb4-51b21858b125 tempest-TaggedAttachmentsTest-498013944 None] Lock "cinder-862c6931-1e28-40f6-a448-842f62153799-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:58 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d" returned: 0 in 0.836s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:58 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d Jul 07 18:01:58 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:01:59 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d49948c3-3151-46bb-9894-0d768153fe7d" returned: 0 in 0.847s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Lock "cinder-quobyte-d49948c3-3151-46bb-9894-0d768153fe7d" released by "delete_volume" :: held 1.765s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['3faf07ba-4798-4477-a692-520dd486fc3f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:59 devstack cinder-volume[86972]: WARNING cinder.quota [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1135432117 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1135432117, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Created reservations ['e24491cb-7947-4c44-b15d-3bc77f86afe2', '15f20c2d-3288-48de-91b1-3c50fe6dfc8d', '4b605488-1649-49db-9353-2402710f173f', 'ad1485ab-8401-41f3-9b28-89086cfd0777'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:01:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:01:59 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:01:59 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:00 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.991s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:00 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:02:00 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4f221dae-e93b-4423-bf6f-2c31a9d9f420 tempest-GroupSnapshotsTest-1768541375 None] Delete group completed successfully. Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Flow 'volume_create_manager' (af118691-39e3-4988-a9f6-c6002abb8f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82fac6d-4a64-4d13-9c92-6789a156d7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82fac6d-4a64-4d13-9c92-6789a156d7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2079795349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200d05b-f80c-4efb-8825-84586b54aa01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7735b00f64992858f88571f3d9fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:03Z,use_quota=True,user_id='1252d403f7054eb583c57d4cf23ba943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89723216-ad65-4c3c-936b-1f591f984046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89723216-ad65-4c3c-936b-1f591f984046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077a1233-b67f-4300-b9a6-129d9498940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077a1233-b67f-4300-b9a6-129d9498940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5200d05b-f80c-4efb-8825-84586b54aa01', 'volume_name': 'volume-5200d05b-f80c-4efb-8825-84586b54aa01', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8fe8bb-2e32-476d-a3ba-91c6c0d891e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8fe8bb-2e32-476d-a3ba-91c6c0d891e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7c31e0-78fd-4fba-9872-913bbdc9e455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:03 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Volume 5200d05b-f80c-4efb-8825-84586b54aa01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5200d05b-f80c-4efb-8825-84586b54aa01', 'volume_size': 1} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2079795349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200d05b-f80c-4efb-8825-84586b54aa01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7735b00f64992858f88571f3d9fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:03Z,use_quota=True,user_id='1252d403f7054eb583c57d4cf23ba943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Creating volume 5200d05b-f80c-4efb-8825-84586b54aa01 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:02:03 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:02:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:03 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 1073741824 Jul 07 18:02:03 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:04 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 1073741824" returned: 0 in 1.081s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:04 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 Jul 07 18:02:04 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:05 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01" returned: 0 in 0.836s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:02:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7c31e0-78fd-4fba-9872-913bbdc9e455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5200d05b-f80c-4efb-8825-84586b54aa01', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44c20e-3381-4e84-a733-c35986e8af23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:05 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Volume volume-5200d05b-f80c-4efb-8825-84586b54aa01 (5200d05b-f80c-4efb-8825-84586b54aa01): created successfully Jul 07 18:02:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c44c20e-3381-4e84-a733-c35986e8af23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Flow 'volume_create_manager' (af118691-39e3-4988-a9f6-c6002abb8f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:05 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-19bd4041-6775-49d8-a9a1-06f24cc3302a tempest-AttachVolumeNegativeTest-331721094 None] Created volume successfully. Jul 07 18:02:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-e25f1506-4b75-4485-8381-987df93bb152 req-50894954-ba19-4300-87d2-6e3c9d50c395 tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-e25f1506-4b75-4485-8381-987df93bb152 req-50894954-ba19-4300-87d2-6e3c9d50c395 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:10 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a6585d-c1c4-43d7-98b4-a519e36bfe41]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-e25f1506-4b75-4485-8381-987df93bb152 req-50894954-ba19-4300-87d2-6e3c9d50c395 tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:10 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 Jul 07 18:02:10 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:11 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-e25f1506-4b75-4485-8381-987df93bb152 req-50894954-ba19-4300-87d2-6e3c9d50c395 tempest-AttachVolumeNegativeTest-331721094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01" returned: 0 in 0.832s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-e25f1506-4b75-4485-8381-987df93bb152 req-50894954-ba19-4300-87d2-6e3c9d50c395 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-e25f1506-4b75-4485-8381-987df93bb152 req-50894954-ba19-4300-87d2-6e3c9d50c395 tempest-AttachVolumeNegativeTest-331721094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-5200d05b-f80c-4efb-8825-84586b54aa01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bbf37d4-c0e6-4a71-af5a-3a0015fae386', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:02:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-e25f1506-4b75-4485-8381-987df93bb152 req-50894954-ba19-4300-87d2-6e3c9d50c395 tempest-AttachVolumeNegativeTest-331721094 None] attachment_update completed successfully. Jul 07 18:02:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:02:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:12 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:02:12 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:13 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.048s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:02:17 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=84,cinder:SELECT=86,cinder:INSERT=21,cinder:DELETE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:02:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-0f7ba95a-6a0c-4898-9aa8-6aafc60e728f req-023c2359-7706-478b-a27e-dfc7210482ad tempest-AttachVolumeTestJSON-910217716 None] Terminate volume connection completed successfully. Jul 07 18:02:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-0f7ba95a-6a0c-4898-9aa8-6aafc60e728f req-023c2359-7706-478b-a27e-dfc7210482ad tempest-AttachVolumeTestJSON-910217716 None] Deleting attachment ee9bd3f7-5e01-4a39-9d39-9b0acfe25c41. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:02:27 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=30,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Flow 'volume_create_manager' (1bf0bf78-d1bf-4a52-a770-256efe759978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5778b36f-bf4a-4f16-a67a-829a8c49ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5778b36f-bf4a-4f16-a67a-829a8c49ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-767722094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900bced5-ae70-4ce0-9474-53e8ee6209d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c185578180f49c78a49f5660fbf8927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:45Z,use_quota=True,user_id='c2b0d251fdd6456a9c64bd7b5cdf51de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdae2adf-a2fe-42ec-874b-1e951ac95ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdae2adf-a2fe-42ec-874b-1e951ac95ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a18cf1-65c9-4619-90ef-a028280ed004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a18cf1-65c9-4619-90ef-a028280ed004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900bced5-ae70-4ce0-9474-53e8ee6209d3', 'volume_name': 'volume-900bced5-ae70-4ce0-9474-53e8ee6209d3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ab0718-bbb0-4547-9975-2587f4e63d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ab0718-bbb0-4547-9975-2587f4e63d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f03546-2970-48bf-a9aa-ff4238347bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:44 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Volume 900bced5-ae70-4ce0-9474-53e8ee6209d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900bced5-ae70-4ce0-9474-53e8ee6209d3', 'volume_size': 1} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-767722094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900bced5-ae70-4ce0-9474-53e8ee6209d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c185578180f49c78a49f5660fbf8927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:02:45Z,use_quota=True,user_id='c2b0d251fdd6456a9c64bd7b5cdf51de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Creating volume 900bced5-ae70-4ce0-9474-53e8ee6209d3 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:02:44 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:02:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:44 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 1073741824 Jul 07 18:02:44 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:45 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 1073741824" returned: 0 in 0.973s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:45 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 Jul 07 18:02:45 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:46 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:02:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f03546-2970-48bf-a9aa-ff4238347bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900bced5-ae70-4ce0-9474-53e8ee6209d3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2367b637-19e9-48c6-8af8-28521c3fdeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:02:46 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Volume volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 (900bced5-ae70-4ce0-9474-53e8ee6209d3): created successfully Jul 07 18:02:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2367b637-19e9-48c6-8af8-28521c3fdeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:02:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Flow 'volume_create_manager' (1bf0bf78-d1bf-4a52-a770-256efe759978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:02:46 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4b81a954-d1cd-4538-b931-108ac90d7db2 tempest-SnapshotMetadataTestJSON-829674682 None] Created volume successfully. Jul 07 18:02:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:02:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:02:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Creating offline snapshot 7b1036f4-fd7e-4b2b-87c8-aabec6357c56 of volume 900bced5-ae70-4ce0-9474-53e8ee6209d3 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:02:47 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8598db-6984-444c-b8e9-8e5907b9a75d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:47 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 Jul 07 18:02:47 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:48 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3" returned: 0 in 1.005s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:48 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 1G Jul 07 18:02:48 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:49 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 1G" returned: 0 in 1.172s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:49 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 Jul 07 18:02:49 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:50 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56" returned: 0 in 0.923s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:50 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 is being set with open permissions: ugo+rw Jul 07 18:02:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:50 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 Jul 07 18:02:50 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:51 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56" returned: 0 in 0.688s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:51 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.info Jul 07 18:02:51 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:51 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.info" returned: 0 in 0.692s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:51 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.info is being set with open permissions: ugo+rw Jul 07 18:02:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:51 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.info Jul 07 18:02:51 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:52 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.info" returned: 0 in 0.768s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.407s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:02:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e4e4b820-4007-4050-9143-990d48ece15e tempest-SnapshotMetadataTestJSON-829674682 None] Create snapshot completed successfully Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Acquiring lock "cinder-7b1036f4-fd7e-4b2b-87c8-aabec6357c56-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-7b1036f4-fd7e-4b2b-87c8-aabec6357c56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Acquiring lock "cinder-quobyte-900bced5-ae70-4ce0-9474-53e8ee6209d3" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-quobyte-900bced5-ae70-4ce0-9474-53e8ee6209d3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Acquiring lock "cinder-quobyte-7b1036f4-fd7e-4b2b-87c8-aabec6357c56" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-quobyte-7b1036f4-fd7e-4b2b-87c8-aabec6357c56" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Deleting offline snapshot 7b1036f4-fd7e-4b2b-87c8-aabec6357c56 of volume 900bced5-ae70-4ce0-9474-53e8ee6209d3 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] snapshot_file for this snap is: volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[db53c13f-bc3d-4566-acf2-595330cf9811]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:54 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 Jul 07 18:02:54 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:55 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56" returned: 0 in 0.887s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-900bced5-ae70-4ce0-9474-53e8ee6209d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:02:55 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cc765c-2c58-4587-84c7-bd8e842bb362]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:55 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 Jul 07 18:02:55 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:56 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3" returned: 0 in 0.789s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:56 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 Jul 07 18:02:56 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:57 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56" returned: 0 in 1.090s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:57 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56 Jul 07 18:02:57 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:58 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3.7b1036f4-fd7e-4b2b-87c8-aabec6357c56" returned: 0 in 0.890s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-quobyte-7b1036f4-fd7e-4b2b-87c8-aabec6357c56" released by "_delete_snapshot" :: held 3.817s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-quobyte-900bced5-ae70-4ce0-9474-53e8ee6209d3" released by "delete_snapshot" :: held 3.846s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:58 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Created reservations ['532e03a3-b116-437b-bac7-859832d5c5b4', '6ac8ff84-d15a-4403-a655-42b43e0d0ca4', 'b2d53c53-df05-4418-b73d-2b0e8cff62f5', '3ccb7553-2210-4a75-929c-3ef2cfa39908'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:02:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Delete snapshot completed successfully. Jul 07 18:02:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3338a35-d921-4d82-b463-de9ef0833b56 tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-7b1036f4-fd7e-4b2b-87c8-aabec6357c56-delete_snapshot" released by "delete_snapshot" :: held 4.067s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:02:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Acquiring lock "cinder-900bced5-ae70-4ce0-9474-53e8ee6209d3-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-900bced5-ae70-4ce0-9474-53e8ee6209d3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Acquiring lock "cinder-quobyte-900bced5-ae70-4ce0-9474-53e8ee6209d3" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:02:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-quobyte-900bced5-ae70-4ce0-9474-53e8ee6209d3" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:02:59 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad854f2-c737-408f-80f0-cc1964651daa]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:02:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:59 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 Jul 07 18:02:59 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:02:59 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Jul 07 18:02:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:02:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:02:59 devstack sudo[91764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3 Jul 07 18:02:59 devstack sudo[91764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:00 devstack sudo[91764]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-900bced5-ae70-4ce0-9474-53e8ee6209d3" returned: 0 in 0.622s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-quobyte-900bced5-ae70-4ce0-9474-53e8ee6209d3" released by "delete_volume" :: held 1.561s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:02 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Created reservations ['5787e3b3-89a8-47b5-8844-2e5ce07b333d', 'c870e2df-9702-430f-bb91-a0899cc13f90', '2e2f1910-31e2-40f0-acc4-b8c6ead82cb3', 'b3aa9dbf-5d71-49ee-bf50-0e64d7823e05'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:03:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:05 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:03:05 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:06 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.977s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:06 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:03:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Deleted volume successfully. Jul 07 18:03:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81523905-324a-4ea0-9516-ae7a1666d33c tempest-SnapshotMetadataTestJSON-829674682 None] Lock "cinder-900bced5-ae70-4ce0-9474-53e8ee6209d3-delete_volume" released by "delete_volume" :: held 7.692s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Flow 'volume_create_manager' (a19f7763-f338-4a1f-b728-b26c6f7455ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ecb650-6dda-47a6-9d59-4d80d91107e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ecb650-6dda-47a6-9d59-4d80d91107e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1733890813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75adc6f4-e3ec-4af8-ab5d-de1419883e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb38addc309c4848b6bac3e2eee7532f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:10Z,use_quota=True,user_id='eed7409594e641608db4bdd164accc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43b4fff-b64d-48cf-989f-31fd4ddf97f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43b4fff-b64d-48cf-989f-31fd4ddf97f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5d83b5-6b23-4147-9e48-de08a3d24436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5d83b5-6b23-4147-9e48-de08a3d24436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75adc6f4-e3ec-4af8-ab5d-de1419883e31', 'volume_name': 'volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de77fdb5-2b4a-474b-893c-e3e7aa2efcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de77fdb5-2b4a-474b-893c-e3e7aa2efcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ae010f-7ee0-4870-b973-d58d9965e056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:09 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Volume 75adc6f4-e3ec-4af8-ab5d-de1419883e31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31', 'volume_size': 1} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1733890813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75adc6f4-e3ec-4af8-ab5d-de1419883e31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb38addc309c4848b6bac3e2eee7532f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:10Z,use_quota=True,user_id='eed7409594e641608db4bdd164accc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Creating volume 75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:09 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:03:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:09 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 1073741824 Jul 07 18:03:09 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Flow 'volume_create_manager' (28283027-feba-415c-9661-372cb13274a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245ad263-9073-438d-9e8f-30078df2f1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245ad263-9073-438d-9e8f-30078df2f1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1079675607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9066a6d-3b73-4aef-9044-f01ce883305b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993178f4e64f4ffb886521068ac8add2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:10Z,use_quota=True,user_id='98fe5338ee8041b1a8b39e8bc68a264c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96167bfc-43d8-4bb1-b9a5-f4c7f5d580a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96167bfc-43d8-4bb1-b9a5-f4c7f5d580a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823426f4-c80f-4430-bc95-c7d398ba7705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823426f4-c80f-4430-bc95-c7d398ba7705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9066a6d-3b73-4aef-9044-f01ce883305b', 'volume_name': 'volume-d9066a6d-3b73-4aef-9044-f01ce883305b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9264cc2f-6b94-48f0-947d-b47eb98d8b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9264cc2f-6b94-48f0-947d-b47eb98d8b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5415778-4a30-40fe-ba5c-34704d0cb48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:10 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Volume d9066a6d-3b73-4aef-9044-f01ce883305b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9066a6d-3b73-4aef-9044-f01ce883305b', 'volume_size': 1} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:10 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 1073741824" returned: 0 in 1.132s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:10 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 Jul 07 18:03:10 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:11 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31" returned: 0 in 0.801s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.295s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1079675607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9066a6d-3b73-4aef-9044-f01ce883305b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='993178f4e64f4ffb886521068ac8add2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:10Z,use_quota=True,user_id='98fe5338ee8041b1a8b39e8bc68a264c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Creating volume d9066a6d-3b73-4aef-9044-f01ce883305b {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:11 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:11 devstack sudo[91819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b 1073741824 Jul 07 18:03:11 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ae010f-7ee0-4870-b973-d58d9965e056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f6344c-7dd4-481c-b330-831faa6565ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:11 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Volume volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 (75adc6f4-e3ec-4af8-ab5d-de1419883e31): created successfully Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f6344c-7dd4-481c-b330-831faa6565ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Flow 'volume_create_manager' (a19f7763-f338-4a1f-b728-b26c6f7455ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-10a78927-2d48-4cbc-a0ea-6de9ebff8752 tempest-VolumesDeleteCascade-1003872133 None] Created volume successfully. Jul 07 18:03:12 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b 1073741824" returned: 0 in 0.932s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:12 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b Jul 07 18:03:12 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:03:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:12 devstack sudo[91826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:03:12 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:13 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b" returned: 0 in 0.953s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.489s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5415778-4a30-40fe-ba5c-34704d0cb48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9066a6d-3b73-4aef-9044-f01ce883305b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6156bc-9e9b-4fbc-8dd5-26ad3f84e6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Creating offline snapshot 6fc5afe3-ab23-4cfc-b215-3431b0f351dc of volume 75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:03:13 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Volume volume-d9066a6d-3b73-4aef-9044-f01ce883305b (d9066a6d-3b73-4aef-9044-f01ce883305b): created successfully Jul 07 18:03:13 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d6156bc-9e9b-4fbc-8dd5-26ad3f84e6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Flow 'volume_create_manager' (28283027-feba-415c-9661-372cb13274a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0ab048-3213-4aad-b333-0c16fa9b720a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.952s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:03:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1401725a-a516-4d31-9329-52bc3746ca1a tempest-ServerActionsTestOtherA-1380430775 None] Created volume successfully. Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 8 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:03:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:03:13 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 Jul 07 18:03:13 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:14 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31" returned: 0 in 1.163s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:14 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc 1G Jul 07 18:03:14 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:15 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc 1G" returned: 0 in 0.926s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:15 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc Jul 07 18:03:15 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:16 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc" returned: 0 in 0.704s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:16 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc is being set with open permissions: ugo+rw Jul 07 18:03:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:16 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc Jul 07 18:03:16 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:16 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-a2206b66-d470-4e29-87b6-7bc89d6840e3 req-861a5d35-a9a8-4472-9684-7689a6986118 tempest-AttachVolumeNegativeTest-331721094 None] Terminate volume connection completed successfully. Jul 07 18:03:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-a2206b66-d470-4e29-87b6-7bc89d6840e3 req-861a5d35-a9a8-4472-9684-7689a6986118 tempest-AttachVolumeNegativeTest-331721094 None] Deleting attachment 7bbf37d4-c0e6-4a71-af5a-3a0015fae386. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:03:17 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc" returned: 0 in 0.660s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:17 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.info Jul 07 18:03:17 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:17 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.info" returned: 0 in 0.628s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:17 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.info is being set with open permissions: ugo+rw Jul 07 18:03:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:17 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.info Jul 07 18:03:17 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:18 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.info" returned: 0 in 0.616s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.874s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:18 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-44fdb2cc-f952-48c6-ab80-e2ec88d5b6d7 tempest-VolumesDeleteCascade-1003872133 None] Create snapshot completed successfully Jul 07 18:03:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Creating offline snapshot 81c3abc6-b434-4101-9614-5d837842a16a of volume 75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:03:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9703a-e56c-46da-9523-ee5137edd2c1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:19 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc Jul 07 18:03:19 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:20 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc" returned: 0 in 0.870s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:03:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:20 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a 1G Jul 07 18:03:20 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:21 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a 1G" returned: 0 in 1.289s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:22 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a Jul 07 18:03:22 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:22 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a" returned: 0 in 0.910s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:22 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a is being set with open permissions: ugo+rw Jul 07 18:03:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:22 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a Jul 07 18:03:22 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:23 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a" returned: 0 in 0.931s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.210s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ef4a9a75-8c37-4448-95a3-6af1ecfc2d4f tempest-VolumesDeleteCascade-1003872133 None] Create snapshot completed successfully Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-75adc6f4-e3ec-4af8-ab5d-de1419883e31-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-75adc6f4-e3ec-4af8-ab5d-de1419883e31-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Performing cascade delete. {{(pid=86972) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-6fc5afe3-ab23-4cfc-b215-3431b0f351dc-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-6fc5afe3-ab23-4cfc-b215-3431b0f351dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-75adc6f4-e3ec-4af8-ab5d-de1419883e31" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-75adc6f4-e3ec-4af8-ab5d-de1419883e31" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-6fc5afe3-ab23-4cfc-b215-3431b0f351dc" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-6fc5afe3-ab23-4cfc-b215-3431b0f351dc" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Deleting offline snapshot 6fc5afe3-ab23-4cfc-b215-3431b0f351dc of volume 75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] snapshot_file for this snap is: volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36763e6-5bfc-4bd7-adaa-b146e3475c99]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:25 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc Jul 07 18:03:25 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:26 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc" returned: 0 in 0.982s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:03:26 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[865f086e-a596-43f7-8415-28ec89176373]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:26 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 Jul 07 18:03:26 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:27 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31" returned: 0 in 1.075s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:27 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed016db-75f6-489e-86ad-051e74f9346b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:27 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a Jul 07 18:03:27 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:28 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a" returned: 0 in 1.191s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:03:28 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d94940-4af5-4e56-82cb-45ceb72530a5]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:28 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc Jul 07 18:03:28 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:30 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc" returned: 0 in 1.392s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:03:30 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8117c276-726a-42eb-a7ec-cf380887fabb]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:30 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 Jul 07 18:03:30 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:31 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31" returned: 0 in 1.505s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:31 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc Jul 07 18:03:31 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:32 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc" returned: 0 in 1.120s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:32 devstack sudo[92148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc Jul 07 18:03:32 devstack sudo[92148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:33 devstack sudo[92148]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.6fc5afe3-ab23-4cfc-b215-3431b0f351dc" returned: 0 in 0.679s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a -F qcow2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:33 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a -F qcow2 Jul 07 18:03:33 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:34 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a -F qcow2" returned: 0 in 0.713s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-6fc5afe3-ab23-4cfc-b215-3431b0f351dc" released by "_delete_snapshot" :: held 8.984s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-75adc6f4-e3ec-4af8-ab5d-de1419883e31" released by "delete_snapshot" :: held 9.034s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Created reservations ['7548bf99-88bc-404c-b3d1-0d7d4647f110', '64081ca1-f408-4189-a04c-9e85d414220b', '046d57d8-0851-458e-8292-f0dda420e780', 'a0b68037-a72b-4453-94e3-ea86025051fc'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:03:36 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Delete snapshot completed successfully. Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-6fc5afe3-ab23-4cfc-b215-3431b0f351dc-delete_snapshot" released by "delete_snapshot" :: held 11.555s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-81c3abc6-b434-4101-9614-5d837842a16a-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-81c3abc6-b434-4101-9614-5d837842a16a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-75adc6f4-e3ec-4af8-ab5d-de1419883e31" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-75adc6f4-e3ec-4af8-ab5d-de1419883e31" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-81c3abc6-b434-4101-9614-5d837842a16a" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-81c3abc6-b434-4101-9614-5d837842a16a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Deleting offline snapshot 81c3abc6-b434-4101-9614-5d837842a16a of volume 75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] snapshot_file for this snap is: volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11c5b1e-0284-4a70-9fcd-fe3a39cafcd4]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:37 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a Jul 07 18:03:37 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:37 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a" returned: 0 in 1.105s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:03:38 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a036014-51a3-46af-b860-43532960b430]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:38 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 Jul 07 18:03:38 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:39 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31" returned: 0 in 1.369s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:39 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a Jul 07 18:03:39 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:40 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a" returned: 0 in 1.207s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:40 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a Jul 07 18:03:40 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:41 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31.81c3abc6-b434-4101-9614-5d837842a16a" returned: 0 in 1.087s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-81c3abc6-b434-4101-9614-5d837842a16a" released by "_delete_snapshot" :: held 4.924s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-75adc6f4-e3ec-4af8-ab5d-de1419883e31" released by "delete_snapshot" :: held 4.961s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=37,cinder:SELECT=32,cinder:INSERT=9 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=38,cinder:UPDATE=28,cinder:DELETE=7,cinder:INSERT=8 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Created reservations ['a6f96a67-23b4-4c02-92aa-05cca1fd273a', '3eedbde5-8bce-4cce-acc0-3018e418c000', 'dd5ce63e-459a-4105-9f1c-1c401389ed57', '55e085e0-df28-4a2d-9316-42ff9f902c7b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:03:41 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Delete snapshot completed successfully. Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-81c3abc6-b434-4101-9614-5d837842a16a-delete_snapshot" released by "delete_snapshot" :: held 5.197s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Snapshots deleted, issuing volume delete {{(pid=86972) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-75adc6f4-e3ec-4af8-ab5d-de1419883e31" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-75adc6f4-e3ec-4af8-ab5d-de1419883e31" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a9c1c1-24a1-49b0-8971-5a47261aac5d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:42 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 Jul 07 18:03:42 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:42 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31" returned: 0 in 1.000s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:43 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31 Jul 07 18:03:43 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:43 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-75adc6f4-e3ec-4af8-ab5d-de1419883e31" returned: 0 in 0.673s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-75adc6f4-e3ec-4af8-ab5d-de1419883e31" released by "delete_volume" :: held 1.733s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:43 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Created reservations ['2ee2f350-15e5-4b85-9fda-316033f6c8d4', '9131c825-1f4e-4183-8a4f-2f1789fedac3', '4bda89f4-2646-4f41-8cf0-98b194f9df11', 'dce5d7c8-0769-4a29-8d6f-8c9cc01bfe59'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:03:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:43 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:03:43 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:44 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.684s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:44 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:03:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Deleted volume successfully. Jul 07 18:03:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c0a73f13-22c1-4a9f-bb9e-32f2a2636f45 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-75adc6f4-e3ec-4af8-ab5d-de1419883e31-delete_volume" released by "delete_volume" :: held 19.449s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Flow 'volume_create_manager' (db4c56de-ee0b-41b2-a07c-126f9aa00f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050c6ae3-b5fc-4ff0-8fca-b102487b5449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050c6ae3-b5fc-4ff0-8fca-b102487b5449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1039171821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f030a858-d382-487d-9009-cbead96b121f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb38addc309c4848b6bac3e2eee7532f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:45Z,use_quota=True,user_id='eed7409594e641608db4bdd164accc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18da08ed-68d2-460a-ac86-b0500dc97124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18da08ed-68d2-460a-ac86-b0500dc97124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102e9c17-e445-4cc6-91e0-61059bb93387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102e9c17-e445-4cc6-91e0-61059bb93387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f030a858-d382-487d-9009-cbead96b121f', 'volume_name': 'volume-f030a858-d382-487d-9009-cbead96b121f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862cc7af-8e5d-4ed4-abf5-eccd98c47899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862cc7af-8e5d-4ed4-abf5-eccd98c47899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f6f3a5-8799-46f1-b84e-11d70d6ed725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:45 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Volume f030a858-d382-487d-9009-cbead96b121f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f030a858-d382-487d-9009-cbead96b121f', 'volume_size': 1} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1039171821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f030a858-d382-487d-9009-cbead96b121f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb38addc309c4848b6bac3e2eee7532f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:45Z,use_quota=True,user_id='eed7409594e641608db4bdd164accc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Creating volume f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:45 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:03:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:45 devstack sudo[92226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f 1073741824 Jul 07 18:03:45 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:46 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f 1073741824" returned: 0 in 0.988s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:46 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f Jul 07 18:03:46 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:46 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:03:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f6f3a5-8799-46f1-b84e-11d70d6ed725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f030a858-d382-487d-9009-cbead96b121f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1759938-48e0-43e8-81e8-65084962bfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:47 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Volume volume-f030a858-d382-487d-9009-cbead96b121f (f030a858-d382-487d-9009-cbead96b121f): created successfully Jul 07 18:03:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1759938-48e0-43e8-81e8-65084962bfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Flow 'volume_create_manager' (db4c56de-ee0b-41b2-a07c-126f9aa00f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:47 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0ea36bca-90e7-45c4-a842-8d5212871da9 tempest-VolumesDeleteCascade-1003872133 None] Created volume successfully. Jul 07 18:03:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Creating offline snapshot 74c45e8d-6f58-4bc5-9a68-ea768be5430c of volume f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:03:47 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f2186-e65e-483f-9405-707ac7b49183]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:47 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f Jul 07 18:03:47 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:48 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:48 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c 1G Jul 07 18:03:48 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:49 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c 1G" returned: 0 in 0.822s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f030a858-d382-487d-9009-cbead96b121f -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:49 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f030a858-d382-487d-9009-cbead96b121f -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c Jul 07 18:03:49 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:49 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f030a858-d382-487d-9009-cbead96b121f -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c" returned: 0 in 0.780s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:49 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c is being set with open permissions: ugo+rw Jul 07 18:03:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:49 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c Jul 07 18:03:49 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:50 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c" returned: 0 in 0.690s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:50 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.info Jul 07 18:03:50 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:51 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.info" returned: 0 in 1.375s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:51 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.info is being set with open permissions: ugo+rw Jul 07 18:03:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:52 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.info Jul 07 18:03:52 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:52 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.info" returned: 0 in 0.846s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.449s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0553762c-b7c7-484f-9056-1d2143025927 tempest-VolumesDeleteCascade-1003872133 None] Create snapshot completed successfully Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Flow 'volume_create_manager' (06173d94-e1f5-4821-9472-582da902b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f4f132-8635-43e6-8121-5ec805c6d954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f4f132-8635-43e6-8121-5ec805c6d954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-101389806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef087a7a-71e0-46d4-ac44-629a1b294076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abb6911430648a4b162a9a78a5ca28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:54Z,use_quota=True,user_id='219a51d2dfed4593b6e4deeb057f1a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2aec22-5db4-4cfa-82de-768c8fddfa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2aec22-5db4-4cfa-82de-768c8fddfa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa98c4ba-b37f-422c-a4dc-63ce943e5bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa98c4ba-b37f-422c-a4dc-63ce943e5bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef087a7a-71e0-46d4-ac44-629a1b294076', 'volume_name': 'volume-ef087a7a-71e0-46d4-ac44-629a1b294076', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d5831f-5e19-4d81-84a8-b4240709ed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d5831f-5e19-4d81-84a8-b4240709ed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e34113-50b3-4c5b-be95-d40f2a155610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Volume ef087a7a-71e0-46d4-ac44-629a1b294076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef087a7a-71e0-46d4-ac44-629a1b294076', 'volume_size': 1} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-101389806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef087a7a-71e0-46d4-ac44-629a1b294076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abb6911430648a4b162a9a78a5ca28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:54Z,use_quota=True,user_id='219a51d2dfed4593b6e4deeb057f1a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Creating volume ef087a7a-71e0-46d4-ac44-629a1b294076 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:53 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:03:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:53 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 1073741824 Jul 07 18:03:53 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Flow 'volume_create_manager' (d2791922-302a-4055-babb-05512261968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f128ce8-9aea-4820-8f98-1ddbd3b659a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f128ce8-9aea-4820-8f98-1ddbd3b659a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2070820457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c27e8432-3f34-44e7-bbb4-fd870df968a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb38addc309c4848b6bac3e2eee7532f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74c45e8d-6f58-4bc5-9a68-ea768be5430c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:03:54Z,use_quota=True,user_id='eed7409594e641608db4bdd164accc98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9982c0ab-14d1-4eb4-97e1-8714c290b118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9982c0ab-14d1-4eb4-97e1-8714c290b118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0026b5-1a7a-4f03-a8f9-d8b999860ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0026b5-1a7a-4f03-a8f9-d8b999860ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c27e8432-3f34-44e7-bbb4-fd870df968a4', 'volume_name': 'volume-c27e8432-3f34-44e7-bbb4-fd870df968a4', 'volume_size': 1, 'snapshot_id': '74c45e8d-6f58-4bc5-9a68-ea768be5430c'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4583d0d9-2634-4ad8-979c-e83cb00c867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4583d0d9-2634-4ad8-979c-e83cb00c867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a3fa65-6a31-4d2f-8648-0a637de5b79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:54 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Volume c27e8432-3f34-44e7-bbb4-fd870df968a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c27e8432-3f34-44e7-bbb4-fd870df968a4', 'volume_size': 1, 'snapshot_id': '74c45e8d-6f58-4bc5-9a68-ea768be5430c'} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:54 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 1073741824" returned: 0 in 1.172s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:55 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 Jul 07 18:03:55 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:55 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076" returned: 0 in 0.871s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.256s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-74c45e8d-6f58-4bc5-9a68-ea768be5430c-c27e8432-3f34-44e7-bbb4-fd870df968a4" by "_create_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e34113-50b3-4c5b-be95-d40f2a155610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef087a7a-71e0-46d4-ac44-629a1b294076', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7684a956-8009-4bdf-be20-1467fcbbf481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-74c45e8d-6f58-4bc5-9a68-ea768be5430c-c27e8432-3f34-44e7-bbb4-fd870df968a4" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Creating volume c27e8432-3f34-44e7-bbb4-fd870df968a4 from snapshot 74c45e8d-6f58-4bc5-9a68-ea768be5430c {{(pid=86972) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-c27e8432-3f34-44e7-bbb4-fd870df968a4" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:03:55 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Volume volume-ef087a7a-71e0-46d4-ac44-629a1b294076 (ef087a7a-71e0-46d4-ac44-629a1b294076): created successfully Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7684a956-8009-4bdf-be20-1467fcbbf481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Flow 'volume_create_manager' (06173d94-e1f5-4821-9472-582da902b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-82fdd93a-8c81-4783-8b77-a2ba70e6e4fa req-f8227691-a7bd-47d3-b0f5-4716672a4a1d tempest-ServerActionsTestOtherA-1380430775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-c27e8432-3f34-44e7-bbb4-fd870df968a4" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] snapshot: 74c45e8d-6f58-4bc5-9a68-ea768be5430c, volume: c27e8432-3f34-44e7-bbb4-fd870df968a4, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:03:55 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-cbb9590f-9361-415c-8598-5aa2dba95d75 tempest-AttachVolumeTestJSON-910217716 None] Created volume successfully. Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9761049f-54b9-47bb-b462-54e5f3d225e7]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:56 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c Jul 07 18:03:56 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:56 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c" returned: 0 in 0.873s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f030a858-d382-487d-9009-cbead96b121f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:03:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:03:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:03:56 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eb699b-0065-4837-a3ba-d91e4652c318]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:03:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:56 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f Jul 07 18:03:56 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:03:57 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Jul 07 18:03:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f" returned: 0 in 0.815s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:03:57 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:03:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:03:57 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 Jul 07 18:03:57 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-6963141b-33ab-4729-b7e9-2abe48aeea4a req-af864e1d-6c41-4582-b1e5-fa61b64c72fa tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:03 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4" returned: 0 in 6.000s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:03 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[4999b4c2-ece9-4832-9471-c47ac8f037fb]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:03 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f Jul 07 18:04:03 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:04 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f" returned: 0 in 0.896s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:04 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:04:04 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Converted 1024.00 MB image at 170.63 MB/s Jul 07 18:04:04 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 is being set with open permissions: ugo+rw Jul 07 18:04:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:04 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 Jul 07 18:04:04 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:05 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4" returned: 0 in 0.656s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-c27e8432-3f34-44e7-bbb4-fd870df968a4" released by "_copy_volume_from_snapshot" :: held 9.348s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-74c45e8d-6f58-4bc5-9a68-ea768be5430c-c27e8432-3f34-44e7-bbb4-fd870df968a4" released by "_create_volume_from_snapshot" :: held 9.398s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.438s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-82fdd93a-8c81-4783-8b77-a2ba70e6e4fa req-f8227691-a7bd-47d3-b0f5-4716672a4a1d tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.374s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:05 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5070f0a-f4bb-4e33-86de-7356b1ecad67]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-82fdd93a-8c81-4783-8b77-a2ba70e6e4fa req-f8227691-a7bd-47d3-b0f5-4716672a4a1d tempest-ServerActionsTestOtherA-1380430775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:05 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b Jul 07 18:04:05 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:06 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-82fdd93a-8c81-4783-8b77-a2ba70e6e4fa req-f8227691-a7bd-47d3-b0f5-4716672a4a1d tempest-ServerActionsTestOtherA-1380430775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b" returned: 0 in 0.717s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-82fdd93a-8c81-4783-8b77-a2ba70e6e4fa req-f8227691-a7bd-47d3-b0f5-4716672a4a1d tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.736s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-6963141b-33ab-4729-b7e9-2abe48aeea4a req-af864e1d-6c41-4582-b1e5-fa61b64c72fa tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.662s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad58eb2-f1ab-4270-b562-2df29023f1d1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-6963141b-33ab-4729-b7e9-2abe48aeea4a req-af864e1d-6c41-4582-b1e5-fa61b64c72fa tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:06 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 Jul 07 18:04:06 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:06 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-6963141b-33ab-4729-b7e9-2abe48aeea4a req-af864e1d-6c41-4582-b1e5-fa61b64c72fa tempest-AttachVolumeTestJSON-910217716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076" returned: 0 in 0.706s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-6963141b-33ab-4729-b7e9-2abe48aeea4a req-af864e1d-6c41-4582-b1e5-fa61b64c72fa tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.725s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a3fa65-6a31-4d2f-8648-0a637de5b79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c27e8432-3f34-44e7-bbb4-fd870df968a4', 'volume_size': 1, 'snapshot_id': '74c45e8d-6f58-4bc5-9a68-ea768be5430c'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b4a43a-3ed9-470a-ab1d-e0ba31106bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-82fdd93a-8c81-4783-8b77-a2ba70e6e4fa req-f8227691-a7bd-47d3-b0f5-4716672a4a1d tempest-ServerActionsTestOtherA-1380430775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-d9066a6d-3b73-4aef-9044-f01ce883305b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7cd6918-1d20-4fe2-a70a-7ca3630f9fc9', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-6963141b-33ab-4729-b7e9-2abe48aeea4a req-af864e1d-6c41-4582-b1e5-fa61b64c72fa tempest-AttachVolumeTestJSON-910217716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-ef087a7a-71e0-46d4-ac44-629a1b294076', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '420348f6-e4f8-44d9-b155-c50fcbd52b2a', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:04:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Volume volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 (c27e8432-3f34-44e7-bbb4-fd870df968a4): created successfully Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41b4a43a-3ed9-470a-ab1d-e0ba31106bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Flow 'volume_create_manager' (d2791922-302a-4055-babb-05512261968f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-62b3b94e-3e23-411e-8f79-093707ca11f7 tempest-VolumesDeleteCascade-1003872133 None] Created volume successfully. Jul 07 18:04:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-82fdd93a-8c81-4783-8b77-a2ba70e6e4fa req-f8227691-a7bd-47d3-b0f5-4716672a4a1d tempest-ServerActionsTestOtherA-1380430775 None] attachment_update completed successfully. Jul 07 18:04:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-6963141b-33ab-4729-b7e9-2abe48aeea4a req-af864e1d-6c41-4582-b1e5-fa61b64c72fa tempest-AttachVolumeTestJSON-910217716 None] attachment_update completed successfully. Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-f030a858-d382-487d-9009-cbead96b121f-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-f030a858-d382-487d-9009-cbead96b121f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Performing cascade delete. {{(pid=86972) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-74c45e8d-6f58-4bc5-9a68-ea768be5430c-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-74c45e8d-6f58-4bc5-9a68-ea768be5430c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-f030a858-d382-487d-9009-cbead96b121f" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-f030a858-d382-487d-9009-cbead96b121f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-74c45e8d-6f58-4bc5-9a68-ea768be5430c" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-74c45e8d-6f58-4bc5-9a68-ea768be5430c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Deleting offline snapshot 74c45e8d-6f58-4bc5-9a68-ea768be5430c of volume f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] snapshot_file for this snap is: volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[efefbfc3-b0a6-4bfc-afb5-c1abf01008e1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:07 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c Jul 07 18:04:07 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:08 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c" returned: 0 in 0.774s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f030a858-d382-487d-9009-cbead96b121f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:04:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c042e9-f1d7-4f79-a8f1-4cda3b24f6a7]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:08 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f Jul 07 18:04:08 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:09 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f" returned: 0 in 0.771s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:09 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c Jul 07 18:04:09 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:10 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c" returned: 0 in 0.743s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:10 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c Jul 07 18:04:10 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:10 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f.74c45e8d-6f58-4bc5-9a68-ea768be5430c" returned: 0 in 0.646s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-74c45e8d-6f58-4bc5-9a68-ea768be5430c" released by "_delete_snapshot" :: held 3.020s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-f030a858-d382-487d-9009-cbead96b121f" released by "delete_snapshot" :: held 3.041s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Created reservations ['588ebd26-e341-4060-81d1-6a6b93abf64e', 'b2b3e0e8-b4f6-4498-9ac1-83cf39619ac4', 'e965538d-fd49-41ed-b397-54062b52a3f5', '80c7bf24-5ba3-4cad-94db-32de0c4f1c5e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Delete snapshot completed successfully. Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-74c45e8d-6f58-4bc5-9a68-ea768be5430c-delete_snapshot" released by "delete_snapshot" :: held 3.223s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Snapshots deleted, issuing volume delete {{(pid=86972) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-f030a858-d382-487d-9009-cbead96b121f" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-f030a858-d382-487d-9009-cbead96b121f" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:11 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e0edbf-2514-4904-8c83-8cf76337f561]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:11 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f Jul 07 18:04:11 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:11 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f" returned: 0 in 0.762s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:11 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f Jul 07 18:04:11 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:12 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f030a858-d382-487d-9009-cbead96b121f" returned: 0 in 0.774s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Flow 'volume_create_manager' (19087860-dbd5-422f-99c6-cc241b41da75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a7f77d-61cf-4153-8136-55fbf55b82dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-f030a858-d382-487d-9009-cbead96b121f" released by "delete_volume" :: held 1.655s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a7f77d-61cf-4153-8136-55fbf55b82dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1189465555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c8e2d4-0757-4c72-be84-d2e06b1e02a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abb6911430648a4b162a9a78a5ca28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:13Z,use_quota=True,user_id='219a51d2dfed4593b6e4deeb057f1a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877553d2-c1e8-4393-9640-1ae38ee8c0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877553d2-c1e8-4393-9640-1ae38ee8c0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de80d45-bd56-4b82-a6db-b27e81870004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de80d45-bd56-4b82-a6db-b27e81870004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c8e2d4-0757-4c72-be84-d2e06b1e02a4', 'volume_name': 'volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e9f6f6-62ce-4a8d-86c2-52cff9f11929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e9f6f6-62ce-4a8d-86c2-52cff9f11929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c13d17a-0e6c-4343-bf33-4ecdfeb83c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:12 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Volume 06c8e2d4-0757-4c72-be84-d2e06b1e02a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4', 'volume_size': 1} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1189465555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c8e2d4-0757-4c72-be84-d2e06b1e02a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4abb6911430648a4b162a9a78a5ca28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:13Z,use_quota=True,user_id='219a51d2dfed4593b6e4deeb057f1a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Creating volume 06c8e2d4-0757-4c72-be84-d2e06b1e02a4 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:04:12 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:12 devstack sudo[92909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 1073741824 Jul 07 18:04:12 devstack sudo[92909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Created reservations ['5a678660-0014-48c7-abd0-6a3db801972b', '88a834ba-cb6e-4abb-b32e-6aa60ce9a612', '05d3a4b0-369c-4db5-8961-2e1a19411a44', '309ef9d2-57a0-4f09-9223-8ced87e51377'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:12 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:04:12 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:12 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:04:12 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-c27e8432-3f34-44e7-bbb4-fd870df968a4-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-c27e8432-3f34-44e7-bbb4-fd870df968a4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "cinder-quobyte-c27e8432-3f34-44e7-bbb4-fd870df968a4" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-c27e8432-3f34-44e7-bbb4-fd870df968a4" acquired by "delete_volume" :: waited 0.031s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8570e1-88e8-4626-99da-d9426a92f723]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:13 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.836s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 8 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:04:13 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 Jul 07 18:04:13 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:13 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.915s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:13 devstack sudo[92909]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 1073741824" returned: 0 in 1.193s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Deleted volume successfully. Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf0b890d-dae3-4cd1-87fa-f9b5d299007d tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-f030a858-d382-487d-9009-cbead96b121f-delete_volume" released by "delete_volume" :: held 6.246s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:13 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 Jul 07 18:04:13 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:14 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4" returned: 0 in 1.000s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:14 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4 Jul 07 18:04:14 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:14 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4" returned: 0 in 0.899s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:04:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c13d17a-0e6c-4343-bf33-4ecdfeb83c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375a1436-e50e-4d25-9d3c-1272390ce273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:14 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Volume volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 (06c8e2d4-0757-4c72-be84-d2e06b1e02a4): created successfully Jul 07 18:04:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (375a1436-e50e-4d25-9d3c-1272390ce273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Flow 'volume_create_manager' (19087860-dbd5-422f-99c6-cc241b41da75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:14 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a0446d55-4668-49cb-9bf8-62d6228726ab tempest-AttachVolumeTestJSON-910217716 None] Created volume successfully. Jul 07 18:04:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-c2912674-c73a-4f7f-b665-47ae4a03b137 req-a02762c1-ab36-48ac-9337-7ab23e020abe tempest-ServerActionsTestOtherA-1380430775 None] Terminate volume connection completed successfully. Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-c2912674-c73a-4f7f-b665-47ae4a03b137 req-a02762c1-ab36-48ac-9337-7ab23e020abe tempest-ServerActionsTestOtherA-1380430775 None] Deleting attachment a7cd6918-1d20-4fe2-a70a-7ca3630f9fc9. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:04:15 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27e8432-3f34-44e7-bbb4-fd870df968a4" returned: 0 in 0.752s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-quobyte-c27e8432-3f34-44e7-bbb4-fd870df968a4" released by "delete_volume" :: held 1.808s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Created reservations ['558e35c1-cf4d-42fc-9ebb-b5b36e4ae3c7', '30b9c184-457a-4669-b14a-82735e01cbe4', '8a8e0912-2edf-4a1c-b966-8f7f8a730030', '56499959-fe85-49a9-9a9f-43ea853ca51e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:15 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:04:15 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:16 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.776s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:16 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Deleted volume successfully. Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2d054c0a-e9d1-41be-b8f4-8593667a7b88 tempest-VolumesDeleteCascade-1003872133 None] Lock "cinder-c27e8432-3f34-44e7-bbb4-fd870df968a4-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Flow 'volume_create_manager' (335728be-eaff-4318-8d72-da0789170632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffab0b12-2b11-4547-b3e3-65af82f6152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffab0b12-2b11-4547-b3e3-65af82f6152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1430022036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412a077a-d929-4e0e-97b4-b438d8b102e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7735b00f64992858f88571f3d9fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:17Z,use_quota=True,user_id='1252d403f7054eb583c57d4cf23ba943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02482194-f511-41f6-a879-4b31465f7597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02482194-f511-41f6-a879-4b31465f7597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c698e81e-512a-4f5d-ad05-b9a59e1f2f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c698e81e-512a-4f5d-ad05-b9a59e1f2f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412a077a-d929-4e0e-97b4-b438d8b102e0', 'volume_name': 'volume-412a077a-d929-4e0e-97b4-b438d8b102e0', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93289a4e-6340-4999-b197-156e69716bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93289a4e-6340-4999-b197-156e69716bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a791d35a-f10a-4c67-830a-bddf6f63ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:16 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Volume 412a077a-d929-4e0e-97b4-b438d8b102e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412a077a-d929-4e0e-97b4-b438d8b102e0', 'volume_size': 1} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1430022036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412a077a-d929-4e0e-97b4-b438d8b102e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7735b00f64992858f88571f3d9fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:17Z,use_quota=True,user_id='1252d403f7054eb583c57d4cf23ba943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Creating volume 412a077a-d929-4e0e-97b4-b438d8b102e0 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:04:17 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:04:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:17 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 1073741824 Jul 07 18:04:17 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-c2912674-c73a-4f7f-b665-47ae4a03b137 req-93f132a9-3c47-4f09-a7b1-b3fe3d714d5a tempest-ServerActionsTestOtherA-1380430775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:18 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 1073741824" returned: 0 in 1.046s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:18 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 Jul 07 18:04:18 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:18 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-c2912674-c73a-4f7f-b665-47ae4a03b137 req-93f132a9-3c47-4f09-a7b1-b3fe3d714d5a tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.926s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a791d35a-f10a-4c67-830a-bddf6f63ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412a077a-d929-4e0e-97b4-b438d8b102e0', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f424139e-a413-44d3-94ec-db581af4eae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95aa661-5044-49ab-a101-a5b40c2873fa]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c2912674-c73a-4f7f-b665-47ae4a03b137 req-93f132a9-3c47-4f09-a7b1-b3fe3d714d5a tempest-ServerActionsTestOtherA-1380430775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:18 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Volume volume-412a077a-d929-4e0e-97b4-b438d8b102e0 (412a077a-d929-4e0e-97b4-b438d8b102e0): created successfully Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f424139e-a413-44d3-94ec-db581af4eae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Flow 'volume_create_manager' (335728be-eaff-4318-8d72-da0789170632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:18 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-793f61e7-218f-4d18-8cca-2fb2a40e2f00 tempest-AttachVolumeNegativeTest-331721094 None] Created volume successfully. Jul 07 18:04:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-f4545d7e-471c-49f1-9a2e-6d28b32495e4 req-033aab56-be92-4b57-8ec3-c84b034a5eb0 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:18 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b Jul 07 18:04:18 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:19 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-c2912674-c73a-4f7f-b665-47ae4a03b137 req-93f132a9-3c47-4f09-a7b1-b3fe3d714d5a tempest-ServerActionsTestOtherA-1380430775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b" returned: 0 in 0.822s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-c2912674-c73a-4f7f-b665-47ae4a03b137 req-93f132a9-3c47-4f09-a7b1-b3fe3d714d5a tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.857s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-f4545d7e-471c-49f1-9a2e-6d28b32495e4 req-033aab56-be92-4b57-8ec3-c84b034a5eb0 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.686s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[56965c8d-348a-40a1-a114-c2ff498f9f9e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-f4545d7e-471c-49f1-9a2e-6d28b32495e4 req-033aab56-be92-4b57-8ec3-c84b034a5eb0 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-c2912674-c73a-4f7f-b665-47ae4a03b137 req-93f132a9-3c47-4f09-a7b1-b3fe3d714d5a tempest-ServerActionsTestOtherA-1380430775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-d9066a6d-3b73-4aef-9044-f01ce883305b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b27796e-1196-40dc-9b6a-a3a6d84cca6a', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:04:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-c2912674-c73a-4f7f-b665-47ae4a03b137 req-93f132a9-3c47-4f09-a7b1-b3fe3d714d5a tempest-ServerActionsTestOtherA-1380430775 None] attachment_update completed successfully. Jul 07 18:04:19 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 Jul 07 18:04:19 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:20 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-f4545d7e-471c-49f1-9a2e-6d28b32495e4 req-033aab56-be92-4b57-8ec3-c84b034a5eb0 tempest-AttachVolumeTestJSON-910217716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4" returned: 0 in 0.818s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-f4545d7e-471c-49f1-9a2e-6d28b32495e4 req-033aab56-be92-4b57-8ec3-c84b034a5eb0 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.840s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-f4545d7e-471c-49f1-9a2e-6d28b32495e4 req-033aab56-be92-4b57-8ec3-c84b034a5eb0 tempest-AttachVolumeTestJSON-910217716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32cb214f-ded2-4572-97d4-1623122fc06b', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:04:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-f4545d7e-471c-49f1-9a2e-6d28b32495e4 req-033aab56-be92-4b57-8ec3-c84b034a5eb0 tempest-AttachVolumeTestJSON-910217716 None] attachment_update completed successfully. Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Flow 'volume_create_manager' (07ac7c65-a23c-4526-b4dd-5949f0cc6a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf81a83a-b84c-4b18-915d-72e46c292c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf81a83a-b84c-4b18-915d-72e46c292c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-639653075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca9e51f-1504-47b1-b462-3e22d2bb631f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc891f555048d2acfac5ca012ce019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:21Z,use_quota=True,user_id='df96216de8b94d1e8076a710d7b725a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a90b84-2995-44d3-88c2-ae91da2bc9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a90b84-2995-44d3-88c2-ae91da2bc9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ed07d6-789f-40fa-91bf-94a3303528fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ed07d6-789f-40fa-91bf-94a3303528fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ca9e51f-1504-47b1-b462-3e22d2bb631f', 'volume_name': 'volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d576724-0bbf-462c-98bd-1e1bd3220dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d576724-0bbf-462c-98bd-1e1bd3220dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d2e56a-baf8-4f50-8a57-ad5b6a4e6fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:20 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Volume 5ca9e51f-1504-47b1-b462-3e22d2bb631f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f', 'volume_size': 1} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-639653075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ca9e51f-1504-47b1-b462-3e22d2bb631f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59fc891f555048d2acfac5ca012ce019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:21Z,use_quota=True,user_id='df96216de8b94d1e8076a710d7b725a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Creating volume 5ca9e51f-1504-47b1-b462-3e22d2bb631f {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:04:20 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:04:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:20 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f 1073741824 Jul 07 18:04:20 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:21 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f 1073741824" returned: 0 in 0.898s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:21 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f Jul 07 18:04:21 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:22 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f" returned: 0 in 0.722s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:04:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d2e56a-baf8-4f50-8a57-ad5b6a4e6fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fd9ad3-520d-4569-a205-61e320af9579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:22 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Volume volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f (5ca9e51f-1504-47b1-b462-3e22d2bb631f): created successfully Jul 07 18:04:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0fd9ad3-520d-4569-a205-61e320af9579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Flow 'volume_create_manager' (07ac7c65-a23c-4526-b4dd-5949f0cc6a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:22 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-eb931674-95f0-4723-b981-71fbad9e6b6c tempest-VolumesMetadataTest-492533357 None] Created volume successfully. Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-56014285-493f-4193-aae9-a436ffc233da req-8e39b9d1-5d1a-4c39-b0a6-89dc986381d2 tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-56014285-493f-4193-aae9-a436ffc233da req-8e39b9d1-5d1a-4c39-b0a6-89dc986381d2 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd2f214-14f8-4b51-8b28-99efbc6715d2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-56014285-493f-4193-aae9-a436ffc233da req-8e39b9d1-5d1a-4c39-b0a6-89dc986381d2 tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Acquiring lock "cinder-5ca9e51f-1504-47b1-b462-3e22d2bb631f-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Lock "cinder-5ca9e51f-1504-47b1-b462-3e22d2bb631f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Acquiring lock "cinder-quobyte-5ca9e51f-1504-47b1-b462-3e22d2bb631f" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Lock "cinder-quobyte-5ca9e51f-1504-47b1-b462-3e22d2bb631f" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[6977a6e0-e2b7-4f67-9fed-c55a952e190e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:23 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 Jul 07 18:04:23 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:24 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f Jul 07 18:04:24 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:24 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-56014285-493f-4193-aae9-a436ffc233da req-8e39b9d1-5d1a-4c39-b0a6-89dc986381d2 tempest-AttachVolumeNegativeTest-331721094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0" returned: 0 in 0.979s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-56014285-493f-4193-aae9-a436ffc233da req-8e39b9d1-5d1a-4c39-b0a6-89dc986381d2 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.004s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-56014285-493f-4193-aae9-a436ffc233da req-8e39b9d1-5d1a-4c39-b0a6-89dc986381d2 tempest-AttachVolumeNegativeTest-331721094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-412a077a-d929-4e0e-97b4-b438d8b102e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec7ed44c-c8ef-4843-9b76-183841d2d1f8', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:04:24 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f" returned: 0 in 0.857s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:24 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f Jul 07 18:04:24 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-56014285-493f-4193-aae9-a436ffc233da req-8e39b9d1-5d1a-4c39-b0a6-89dc986381d2 tempest-AttachVolumeNegativeTest-331721094 None] attachment_update completed successfully. Jul 07 18:04:25 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5ca9e51f-1504-47b1-b462-3e22d2bb631f" returned: 0 in 0.778s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Lock "cinder-quobyte-5ca9e51f-1504-47b1-b462-3e22d2bb631f" released by "delete_volume" :: held 1.709s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:25 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Created reservations ['a5e93e33-c0d2-4309-af95-94aa95daded8', 'd66e4e8d-ca46-4312-8b72-29afd91a5834', 'c6905fe5-457a-4e69-aab8-c5a076df7d7b', 'b53677c1-12d3-4be3-92ec-e8850a849dd0'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:25 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:04:25 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:26 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.905s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:26 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Deleted volume successfully. Jul 07 18:04:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-376a2cf8-8ce5-45e5-86b0-05a8f47f9edb tempest-VolumesMetadataTest-492533357 None] Lock "cinder-5ca9e51f-1504-47b1-b462-3e22d2bb631f-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:28 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-473fee3c-d778-4cf2-b703-e3bde5c68749 req-1f90307a-92a0-4fc2-b77f-f4274261b36c tempest-AttachVolumeTestJSON-910217716 None] Terminate volume connection completed successfully. Jul 07 18:04:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-473fee3c-d778-4cf2-b703-e3bde5c68749 req-1f90307a-92a0-4fc2-b77f-f4274261b36c tempest-AttachVolumeTestJSON-910217716 None] Deleting attachment 420348f6-e4f8-44d9-b155-c50fcbd52b2a. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Flow 'volume_create_manager' (5baf65a5-bd5d-4df1-ba57-3a64301c594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cd02c1-98c4-435e-91d3-5611f8d51359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cd02c1-98c4-435e-91d3-5611f8d51359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1451721068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91bb30f-8a02-4979-a86f-6b2b109088c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a4e6b6d2b04d1eb2597208d7f428cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:35Z,use_quota=True,user_id='90837264572d4a1bb5776bda04cc68af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec779929-d2b7-495b-8bc5-7d622fb18e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec779929-d2b7-495b-8bc5-7d622fb18e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4a1737-2d39-4734-a6be-35905dc51c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4a1737-2d39-4734-a6be-35905dc51c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91bb30f-8a02-4979-a86f-6b2b109088c3', 'volume_name': 'volume-c91bb30f-8a02-4979-a86f-6b2b109088c3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4faef64-e7d0-41cf-8987-dcdbf9ecbfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4faef64-e7d0-41cf-8987-dcdbf9ecbfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b7f8f7-eb45-49a8-95ce-9ac044c24ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Volume c91bb30f-8a02-4979-a86f-6b2b109088c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91bb30f-8a02-4979-a86f-6b2b109088c3', 'volume_size': 1} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1451721068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91bb30f-8a02-4979-a86f-6b2b109088c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a4e6b6d2b04d1eb2597208d7f428cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:35Z,use_quota=True,user_id='90837264572d4a1bb5776bda04cc68af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Creating volume c91bb30f-8a02-4979-a86f-6b2b109088c3 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:04:35 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:35 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 1073741824 Jul 07 18:04:35 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-09aeeb3a-c687-4b36-8ffa-b065f2e4118a req-e05a89b7-4d1a-41bb-b7f9-a5a28c2e056a tempest-AttachVolumeTestJSON-910217716 None] Terminate volume connection completed successfully. Jul 07 18:04:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-09aeeb3a-c687-4b36-8ffa-b065f2e4118a req-e05a89b7-4d1a-41bb-b7f9-a5a28c2e056a tempest-AttachVolumeTestJSON-910217716 None] Deleting attachment 32cb214f-ded2-4572-97d4-1623122fc06b. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:04:36 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-59df8732-52e4-4e43-8c7b-54c9d1cc5aff req-e97e64ca-ffe0-4e9a-a56c-f72fb939bc2d tempest-AttachVolumeNegativeTest-331721094 None] Terminate volume connection completed successfully. Jul 07 18:04:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-59df8732-52e4-4e43-8c7b-54c9d1cc5aff req-e97e64ca-ffe0-4e9a-a56c-f72fb939bc2d tempest-AttachVolumeNegativeTest-331721094 None] Deleting attachment ec7ed44c-c8ef-4843-9b76-183841d2d1f8. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:04:36 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 1073741824" returned: 0 in 0.927s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:36 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 Jul 07 18:04:36 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:37 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3" returned: 0 in 0.731s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:04:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b7f8f7-eb45-49a8-95ce-9ac044c24ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91bb30f-8a02-4979-a86f-6b2b109088c3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec354195-88de-495c-abd4-8153a6065609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:37 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Volume volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 (c91bb30f-8a02-4979-a86f-6b2b109088c3): created successfully Jul 07 18:04:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec354195-88de-495c-abd4-8153a6065609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Flow 'volume_create_manager' (5baf65a5-bd5d-4df1-ba57-3a64301c594e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:37 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-50cbde7e-4310-43ab-a28e-44852ba374a5 tempest-VolumesTransfersV357Test-1533044031 None] Created volume successfully. Jul 07 18:04:38 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-eeabab99-1022-47e3-a2af-1836b1f11d3e tempest-VolumesTransfersV357Test-837941490 None] Transfer volume completed successfully. Jul 07 18:04:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Acquiring lock "cinder-c91bb30f-8a02-4979-a86f-6b2b109088c3-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Lock "cinder-c91bb30f-8a02-4979-a86f-6b2b109088c3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Acquiring lock "cinder-quobyte-c91bb30f-8a02-4979-a86f-6b2b109088c3" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Lock "cinder-quobyte-c91bb30f-8a02-4979-a86f-6b2b109088c3" acquired by "delete_volume" :: waited 0.034s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:39 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[915b33d2-fe22-4016-a4ed-607ba420258f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:39 devstack sudo[93249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 Jul 07 18:04:39 devstack sudo[93249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:40 devstack sudo[93249]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3" returned: 0 in 1.043s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:40 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3 Jul 07 18:04:40 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:41 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c91bb30f-8a02-4979-a86f-6b2b109088c3" returned: 0 in 0.808s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Lock "cinder-quobyte-c91bb30f-8a02-4979-a86f-6b2b109088c3" released by "delete_volume" :: held 1.956s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:41 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Created reservations ['f68ef92e-0723-4cd0-a23a-2222a28b05bd', '660736b6-6655-45ed-af4e-5453218caf0e', 'c2004315-fc14-4f65-aaf2-facbc8487dca', '1ee7dd3a-36f4-49f2-a1ec-c5ae9c292bfd'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:41 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:04:41 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:42 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=85,cinder:INSERT=14,cinder:UPDATE=79,cinder:DELETE=4 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.769s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Deleted volume successfully. Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:INSERT=21,cinder:UPDATE=82,cinder:SELECT=83,cinder:DELETE=8 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Flow 'volume_create_manager' (30392dd4-cded-4802-a4b2-867fae5524fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d2c9f1-c75c-4c11-91fd-fc6179fe2068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-341491ba-8d79-4b6b-9566-5aab6ba4de3d tempest-VolumesTransfersV357Test-1685447266 None] Lock "cinder-c91bb30f-8a02-4979-a86f-6b2b109088c3-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d2c9f1-c75c-4c11-91fd-fc6179fe2068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1369547647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994a3b7e-778f-4e6b-9af0-570c72656bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a4e6b6d2b04d1eb2597208d7f428cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:43Z,use_quota=True,user_id='90837264572d4a1bb5776bda04cc68af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eabc3e1-bb14-45b2-aa16-c34169ecea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eabc3e1-bb14-45b2-aa16-c34169ecea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c6866f-4ce9-4b7b-b48d-bcf60bd18d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0c6866f-4ce9-4b7b-b48d-bcf60bd18d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '994a3b7e-778f-4e6b-9af0-570c72656bee', 'volume_name': 'volume-994a3b7e-778f-4e6b-9af0-570c72656bee', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ade25e-9936-44dd-8845-adcf7dc18e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ade25e-9936-44dd-8845-adcf7dc18e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d776e53f-a36a-495d-9b1f-fe940e51f56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:42 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Volume 994a3b7e-778f-4e6b-9af0-570c72656bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-994a3b7e-778f-4e6b-9af0-570c72656bee', 'volume_size': 1} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1369547647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994a3b7e-778f-4e6b-9af0-570c72656bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a4e6b6d2b04d1eb2597208d7f428cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:43Z,use_quota=True,user_id='90837264572d4a1bb5776bda04cc68af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Creating volume 994a3b7e-778f-4e6b-9af0-570c72656bee {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:04:42 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:04:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:42 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee 1073741824 Jul 07 18:04:42 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:43 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee 1073741824" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:43 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee Jul 07 18:04:43 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:44 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee" returned: 0 in 0.630s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d776e53f-a36a-495d-9b1f-fe940e51f56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994a3b7e-778f-4e6b-9af0-570c72656bee', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7961d1e-7071-4cc1-a3e1-83a5ecd102d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:44 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Volume volume-994a3b7e-778f-4e6b-9af0-570c72656bee (994a3b7e-778f-4e6b-9af0-570c72656bee): created successfully Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7961d1e-7071-4cc1-a3e1-83a5ecd102d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Flow 'volume_create_manager' (30392dd4-cded-4802-a4b2-867fae5524fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e5875783-f40f-4097-b8d0-e315457f8c95 tempest-VolumesTransfersV357Test-1533044031 None] Created volume successfully. Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Acquiring lock "cinder-994a3b7e-778f-4e6b-9af0-570c72656bee-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Lock "cinder-994a3b7e-778f-4e6b-9af0-570c72656bee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Acquiring lock "cinder-quobyte-994a3b7e-778f-4e6b-9af0-570c72656bee" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Lock "cinder-quobyte-994a3b7e-778f-4e6b-9af0-570c72656bee" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:45 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ae020a-12b4-4e5c-b8a8-65e1496f106d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:45 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee Jul 07 18:04:45 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:45 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee" returned: 0 in 0.814s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:45 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee Jul 07 18:04:45 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "cinder-06c8e2d4-0757-4c72-be84-d2e06b1e02a4-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-06c8e2d4-0757-4c72-be84-d2e06b1e02a4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "cinder-quobyte-06c8e2d4-0757-4c72-be84-d2e06b1e02a4" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-quobyte-06c8e2d4-0757-4c72-be84-d2e06b1e02a4" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:46 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06befda-86a6-4263-b2ca-7841aaeed75d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:46 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 Jul 07 18:04:46 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:46 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-994a3b7e-778f-4e6b-9af0-570c72656bee" returned: 0 in 0.906s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Lock "cinder-quobyte-994a3b7e-778f-4e6b-9af0-570c72656bee" released by "delete_volume" :: held 1.781s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:46 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Created reservations ['f7c994b7-4fed-49b9-ae6c-5f4b3cfc08b5', '6d8b43a6-a13e-4e58-956a-7efaf6f2b1e8', 'f42d4c77-a2d9-4c19-8781-27d49f2a0742', '9bf7dd90-b7d8-490d-8794-97645de5a1dd'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:47 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:04:47 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:47 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4" returned: 0 in 1.059s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:47 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4 Jul 07 18:04:47 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:47 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.973s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:47 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:48 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Deleted volume successfully. Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8635aa33-db7b-42c8-92e9-ea15550f8cf9 tempest-VolumesTransfersV357Test-1685447266 None] Lock "cinder-994a3b7e-778f-4e6b-9af0-570c72656bee-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:48 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-06c8e2d4-0757-4c72-be84-d2e06b1e02a4" returned: 0 in 1.168s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-quobyte-06c8e2d4-0757-4c72-be84-d2e06b1e02a4" released by "delete_volume" :: held 2.294s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Created reservations ['76a56fd4-ba8b-4ed8-812e-bbf69069e93f', 'f694c545-8d90-4ef4-b956-5c1e29727f6d', '66629a26-8b0b-447e-bf11-3ac2c36e9d5a', '2de572a8-e49f-42ee-898c-2af9903cde49'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:48 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:04:48 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:49 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.835s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:49 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:49 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Deleted volume successfully. Jul 07 18:04:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65dfa295-c879-4b19-9e1a-10c1d8609cf3 tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-06c8e2d4-0757-4c72-be84-d2e06b1e02a4-delete_volume" released by "delete_volume" :: held 3.420s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "cinder-ef087a7a-71e0-46d4-ac44-629a1b294076-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-ef087a7a-71e0-46d4-ac44-629a1b294076-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "cinder-quobyte-ef087a7a-71e0-46d4-ac44-629a1b294076" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-quobyte-ef087a7a-71e0-46d4-ac44-629a1b294076" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:49 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6777b7-9913-407c-9400-3df50ef761da]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:50 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 Jul 07 18:04:50 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:50 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076" returned: 0 in 0.876s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:50 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076 Jul 07 18:04:50 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-4628adb2-5ec7-4d40-bbbd-571cee6f8911 req-26cb4654-6717-440e-9de2-eff1f3856bdc tempest-ServerActionsTestOtherA-1380430775 None] Terminate volume connection completed successfully. Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-4628adb2-5ec7-4d40-bbbd-571cee6f8911 req-26cb4654-6717-440e-9de2-eff1f3856bdc tempest-ServerActionsTestOtherA-1380430775 None] Deleting attachment 3b27796e-1196-40dc-9b6a-a3a6d84cca6a. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:04:51 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ef087a7a-71e0-46d4-ac44-629a1b294076" returned: 0 in 0.895s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-quobyte-ef087a7a-71e0-46d4-ac44-629a1b294076" released by "delete_volume" :: held 1.839s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Created reservations ['b3075024-e01e-4837-bc54-31b259be3436', 'ec9b862e-f39c-4faf-9bc0-f0e712e2036b', '504d985e-b819-4ef7-99ba-0470d7b56abd', 'ad99df4a-d744-44c8-97e8-0144b220a3d1'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:51 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:04:51 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "cinder-afa3401d-b68c-4d44-9089-a4867fb5109a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-afa3401d-b68c-4d44-9089-a4867fb5109a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "cinder-quobyte-afa3401d-b68c-4d44-9089-a4867fb5109a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:04:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-quobyte-afa3401d-b68c-4d44-9089-a4867fb5109a" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:04:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59901b9-8fc3-4cb4-9377-6d6b72e63385]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:04:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:52 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a Jul 07 18:04:52 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:52 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.925s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:52 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Deleted volume successfully. Jul 07 18:04:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-670f282e-f753-4bd2-934b-6e05f2a9b0ab tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-ef087a7a-71e0-46d4-ac44-629a1b294076-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:53 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a" returned: 0 in 1.075s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:53 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a Jul 07 18:04:53 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:54 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-afa3401d-b68c-4d44-9089-a4867fb5109a" returned: 0 in 0.794s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-quobyte-afa3401d-b68c-4d44-9089-a4867fb5109a" released by "delete_volume" :: held 1.946s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Created reservations ['3080b602-3c69-40e6-bc55-79a8e82627cf', '1e29eb75-d478-43c8-91b1-54c5b26e6466', '979be929-543d-4130-85fe-a762f5146850', '8e2ea2ee-67e2-4adc-8361-c497f7b5199a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:54 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:04:54 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Flow 'volume_create_manager' (8f33b316-6415-47bc-b8c0-a79b1b5be110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8c6661-d157-46c6-b595-c59fb964e368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8c6661-d157-46c6-b595-c59fb964e368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1924341261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f819a811a904b368cc53dd53042026a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:55Z,use_quota=True,user_id='5ec2df881b9e443792f755a4cc32ba23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87b189-6372-4a18-b4aa-c35136d1b1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d87b189-6372-4a18-b4aa-c35136d1b1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710e61ab-83dc-4c91-b520-fa4f911d04c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710e61ab-83dc-4c91-b520-fa4f911d04c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676', 'volume_name': 'volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a7c334-044e-43e9-8603-7b885641c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a7c334-044e-43e9-8603-7b885641c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ae62ec-e51d-4b65-a0e2-1031bff3a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:54 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Volume ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676', 'volume_size': 1} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1924341261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f819a811a904b368cc53dd53042026a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:04:55Z,use_quota=True,user_id='5ec2df881b9e443792f755a4cc32ba23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Creating volume ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:04:54 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:04:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:55 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 1073741824 Jul 07 18:04:55 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:55 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.824s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:55 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:04:55 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Deleted volume successfully. Jul 07 18:04:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d4e4b8b2-0841-46b1-aad1-677c8e64f679 tempest-AttachVolumeTestJSON-910217716 None] Lock "cinder-afa3401d-b68c-4d44-9089-a4867fb5109a-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:04:56 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 1073741824" returned: 0 in 1.237s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:04:56 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 Jul 07 18:04:56 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:04:57 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Jul 07 18:04:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676" returned: 0 in 0.874s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:04:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:04:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:04:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ae62ec-e51d-4b65-a0e2-1031bff3a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48955693-9395-4a8e-8806-757c0d6bd638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:04:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Volume volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 (ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676): created successfully Jul 07 18:04:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48955693-9395-4a8e-8806-757c0d6bd638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:04:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Flow 'volume_create_manager' (8f33b316-6415-47bc-b8c0-a79b1b5be110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:04:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-cd4c7009-d485-4093-ad28-acef659e3074 tempest-VolumesNegativeTest-345774003 None] Created volume successfully. Jul 07 18:05:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Acquiring lock "cinder-d9066a6d-3b73-4aef-9044-f01ce883305b-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:05:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Lock "cinder-d9066a6d-3b73-4aef-9044-f01ce883305b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:05:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Acquiring lock "cinder-quobyte-d9066a6d-3b73-4aef-9044-f01ce883305b" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:05:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Lock "cinder-quobyte-d9066a6d-3b73-4aef-9044-f01ce883305b" acquired by "delete_volume" :: waited 0.044s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:05:03 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[986087ba-ef69-4ea1-8bba-eb7676b2d150]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:03 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b Jul 07 18:05:03 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0b710f72-6b3b-427c-a8f3-b8338a50e99b tempest-GroupSnapshotsV319Test-363180623 None] Group tempest-GroupSnapshotsV319Test-Group-198236858: creating Jul 07 18:05:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0b710f72-6b3b-427c-a8f3-b8338a50e99b tempest-GroupSnapshotsV319Test-363180623 None] Group tempest-GroupSnapshotsV319Test-Group-198236858: created successfully Jul 07 18:05:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0b710f72-6b3b-427c-a8f3-b8338a50e99b tempest-GroupSnapshotsV319Test-363180623 None] Create group completed successfully. Jul 07 18:05:04 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b" returned: 0 in 0.884s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:04 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b Jul 07 18:05:04 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:04 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9066a6d-3b73-4aef-9044-f01ce883305b" returned: 0 in 0.784s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Lock "cinder-quobyte-d9066a6d-3b73-4aef-9044-f01ce883305b" released by "delete_volume" :: held 1.736s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:05:04 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Created reservations ['836df236-6e3c-447a-b288-88bc05c314f5', '1de5a1cc-2b50-4c65-aad6-37d2b867fe39', '3f0f7339-5b8b-48a0-af2e-6089decbb1dc', '563c75aa-2f0f-4071-b0a1-aec050fb6289'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:05:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:05 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:05:05 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Flow 'volume_create_manager' (d2e0fa5e-d0a4-4f13-9b18-4a5ca4ba3fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef95a6-a73e-44ee-a1ae-542733e960eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ef95a6-a73e-44ee-a1ae-542733e960eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-658706483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb197d9b-08a8-404c-8806-8914bb10ccae,host='devstack@QuobyteHD#QuobyteHD',id=ccd90b06-8fd2-4554-85e3-944805bc2b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7392696f316f44a6a8964d0b46964846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:06Z,use_quota=True,user_id='f425b3410af24f30848f39209ff3b821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e47c6c4-2e71-4dcb-ac4d-9b2b6d9f5af3),volume_type_id=9e47c6c4-2e71-4dcb-ac4d-9b2b6d9f5af3)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3c722e-0be2-47a8-8649-35ce7c99b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3c722e-0be2-47a8-8649-35ce7c99b72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc33f597-abfa-485d-ae0f-764849cc378b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc33f597-abfa-485d-ae0f-764849cc378b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd90b06-8fd2-4554-85e3-944805bc2b59', 'volume_name': 'volume-ccd90b06-8fd2-4554-85e3-944805bc2b59', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7491c3f0-25e5-4f32-96ca-33ec90948575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7491c3f0-25e5-4f32-96ca-33ec90948575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7847a0b-9597-4631-8096-02c2e7228d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Volume ccd90b06-8fd2-4554-85e3-944805bc2b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd90b06-8fd2-4554-85e3-944805bc2b59', 'volume_size': 1} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eb197d9b-08a8-404c-8806-8914bb10ccae,created_at=2026-07-07T16:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-658706483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eb197d9b-08a8-404c-8806-8914bb10ccae,host='devstack@QuobyteHD#QuobyteHD',id=ccd90b06-8fd2-4554-85e3-944805bc2b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7392696f316f44a6a8964d0b46964846',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:06Z,use_quota=True,user_id='f425b3410af24f30848f39209ff3b821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e47c6c4-2e71-4dcb-ac4d-9b2b6d9f5af3),volume_type_id=9e47c6c4-2e71-4dcb-ac4d-9b2b6d9f5af3)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Creating volume ccd90b06-8fd2-4554-85e3-944805bc2b59 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:05:06 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:06 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 1073741824 Jul 07 18:05:06 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:06 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.417s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:05:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Deleted volume successfully. Jul 07 18:05:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5f1b7d58-b54a-494d-aff9-a4db2fc821a0 tempest-ServerActionsTestOtherA-1380430775 None] Lock "cinder-d9066a6d-3b73-4aef-9044-f01ce883305b-delete_volume" released by "delete_volume" :: held 3.504s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:05:07 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 1073741824" returned: 0 in 1.427s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:07 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 Jul 07 18:05:07 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:08 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59" returned: 0 in 1.155s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] <== create_volume: return (2687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:05:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7847a0b-9597-4631-8096-02c2e7228d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd90b06-8fd2-4554-85e3-944805bc2b59', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29eae28-7e3c-4e54-bc6c-a5a6d0fefb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:08 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Volume volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 (ccd90b06-8fd2-4554-85e3-944805bc2b59): created successfully Jul 07 18:05:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f29eae28-7e3c-4e54-bc6c-a5a6d0fefb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Flow 'volume_create_manager' (d2e0fa5e-d0a4-4f13-9b18-4a5ca4ba3fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1982b252-5fa3-415e-a65e-3504f652116f tempest-GroupSnapshotsV319Test-363180623 None] Created volume successfully. Jul 07 18:05:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] GroupSnapshot dd423e0e-cafa-4cb3-acd0-cb1536abdc73: creating. Jul 07 18:05:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Group snapshot dd423e0e-cafa-4cb3-acd0-cb1536abdc73: creating. {{(pid=86972) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 18:05:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Creating offline snapshot 191c9db9-3a6b-49b4-9b0f-78de38ce940e of volume ccd90b06-8fd2-4554-85e3-944805bc2b59 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:05:10 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7333d9d-8466-4b01-83ed-86e85937b0de]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:10 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 Jul 07 18:05:10 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:11 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59" returned: 0 in 0.954s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:11 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e 1G Jul 07 18:05:11 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:12 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e 1G" returned: 0 in 1.160s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:12 devstack sudo[93578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e Jul 07 18:05:12 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:05:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:12 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:05:12 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:13 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e" returned: 0 in 1.575s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:13 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:05:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:14 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e Jul 07 18:05:14 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:14 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.535s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:14 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:05:14 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:05:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 8 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:05:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:05:15 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e" returned: 0 in 1.181s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:15 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.info Jul 07 18:05:15 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:16 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.info" returned: 0 in 1.016s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:16 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:05:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:16 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.info Jul 07 18:05:16 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:17 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.info" returned: 0 in 1.678s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.763s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:18 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f359d1d7-d0b5-48dc-a3da-3a250dde63ca tempest-GroupSnapshotsV319Test-363180623 None] group_snapshot dd423e0e-cafa-4cb3-acd0-cb1536abdc73: created successfully Jul 07 18:05:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] group_snapshot dd423e0e-cafa-4cb3-acd0-cb1536abdc73: deleting Jul 07 18:05:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] group_snapshot dd423e0e-cafa-4cb3-acd0-cb1536abdc73: deleting {{(pid=86972) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 18:05:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Acquiring lock "cinder-quobyte-ccd90b06-8fd2-4554-85e3-944805bc2b59" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:05:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Lock "cinder-quobyte-ccd90b06-8fd2-4554-85e3-944805bc2b59" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:05:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Acquiring lock "cinder-quobyte-191c9db9-3a6b-49b4-9b0f-78de38ce940e" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:05:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Lock "cinder-quobyte-191c9db9-3a6b-49b4-9b0f-78de38ce940e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:05:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Deleting offline snapshot 191c9db9-3a6b-49b4-9b0f-78de38ce940e of volume ccd90b06-8fd2-4554-85e3-944805bc2b59 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:05:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] snapshot_file for this snap is: volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:05:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a3350f-e910-4ad7-b5f8-26e718b9d292]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:20 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e Jul 07 18:05:20 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:21 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e" returned: 0 in 1.589s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccd90b06-8fd2-4554-85e3-944805bc2b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:05:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f262f05-d42f-4ba1-96e7-31bb46448913]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:21 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 Jul 07 18:05:21 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:22 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59" returned: 0 in 1.077s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:22 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e Jul 07 18:05:22 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:23 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e" returned: 0 in 0.896s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:23 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e Jul 07 18:05:23 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:24 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59.191c9db9-3a6b-49b4-9b0f-78de38ce940e" returned: 0 in 0.658s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Lock "cinder-quobyte-191c9db9-3a6b-49b4-9b0f-78de38ce940e" released by "_delete_snapshot" :: held 4.408s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:05:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Lock "cinder-quobyte-ccd90b06-8fd2-4554-85e3-944805bc2b59" released by "delete_snapshot" :: held 4.439s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:05:24 devstack cinder-volume[86972]: WARNING cinder.quota [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1308815060 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1308815060, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:05:24 devstack cinder-volume[86972]: WARNING cinder.quota [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1308815060 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1308815060, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:05:24 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] Created reservations ['e139ff1e-215f-40f2-ae95-db909feb6efc', 'b96af94c-afae-41ba-ae81-4c1405147ca5', 'e9b7ed7a-d261-48ea-9672-be67c3020cd0', '6e56aa38-7625-4a58-861d-f33597008d2c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:05:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-41f8a779-de0e-4827-8d93-7acb8685f7d2 tempest-GroupSnapshotsV319Test-363180623 None] group_snapshot dd423e0e-cafa-4cb3-acd0-cb1536abdc73: deleted successfully Jul 07 18:05:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Acquiring lock "cinder-quobyte-ccd90b06-8fd2-4554-85e3-944805bc2b59" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:05:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Lock "cinder-quobyte-ccd90b06-8fd2-4554-85e3-944805bc2b59" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:05:25 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaea219-6b1d-42a7-8d3a-b27f68a2c096]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:25 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 Jul 07 18:05:25 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:26 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59" returned: 0 in 0.868s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:26 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59 Jul 07 18:05:26 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:27 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ccd90b06-8fd2-4554-85e3-944805bc2b59" returned: 0 in 0.804s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Lock "cinder-quobyte-ccd90b06-8fd2-4554-85e3-944805bc2b59" released by "delete_volume" :: held 1.762s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Created reservations ['a6392e88-8264-48f3-a6ad-4e116675ebd9'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:05:27 devstack cinder-volume[86972]: WARNING cinder.quota [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1308815060 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1308815060, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Created reservations ['4312f4df-73a0-4b06-a14c-373656568059', 'c41a14cf-9469-46d4-9939-7d799a1abee3', 'b0b24557-8c5e-4d98-b3bc-a24e2866a172', '1f6feaad-ac23-422a-8205-381edaf5807f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:27 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:05:27 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:28 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.836s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:28 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:05:28 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-15bc1060-64d2-4a21-a842-d6ad36d63729 tempest-GroupSnapshotsV319Test-363180623 None] Delete group completed successfully. Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Flow 'volume_create_manager' (ee52aae5-6822-45d2-ac87-644fda5c81ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2d157a-7547-4cfe-8e57-f2a61f116f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2d157a-7547-4cfe-8e57-f2a61f116f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-738591023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecb4ebc-34f4-4879-a8a4-24265572d0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7735b00f64992858f88571f3d9fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:35Z,use_quota=True,user_id='1252d403f7054eb583c57d4cf23ba943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c1e6d5-4290-4ec3-85f8-d0a332a44bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c1e6d5-4290-4ec3-85f8-d0a332a44bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3badd4b8-11d6-4c5a-b88e-bd55de887b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3badd4b8-11d6-4c5a-b88e-bd55de887b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eecb4ebc-34f4-4879-a8a4-24265572d0a9', 'volume_name': 'volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801099e9-efad-4ef2-9b63-10a2b6e9d33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801099e9-efad-4ef2-9b63-10a2b6e9d33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6c47da-7bd9-44b3-86b3-b24f9be6a323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:34 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Volume eecb4ebc-34f4-4879-a8a4-24265572d0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9', 'volume_size': 1} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-738591023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecb4ebc-34f4-4879-a8a4-24265572d0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5b7735b00f64992858f88571f3d9fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:35Z,use_quota=True,user_id='1252d403f7054eb583c57d4cf23ba943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Creating volume eecb4ebc-34f4-4879-a8a4-24265572d0a9 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:05:34 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:05:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:35 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 1073741824 Jul 07 18:05:35 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f8b7dc06-d454-4f94-8217-7834ceddd9ef tempest-GroupsV314Test-283198225 None] Group tempest-GroupsV314Test-Group-2108456575: creating Jul 07 18:05:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Acquiring lock "cinder-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:05:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Lock "cinder-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:05:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f8b7dc06-d454-4f94-8217-7834ceddd9ef tempest-GroupsV314Test-283198225 None] Group tempest-GroupsV314Test-Group-2108456575: created successfully Jul 07 18:05:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f8b7dc06-d454-4f94-8217-7834ceddd9ef tempest-GroupsV314Test-283198225 None] Create group completed successfully. Jul 07 18:05:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Acquiring lock "cinder-quobyte-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:05:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Lock "cinder-quobyte-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:05:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c750509a-93cf-4256-aec4-65054331aadc]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:36 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 Jul 07 18:05:36 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:36 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 1073741824" returned: 0 in 1.402s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:36 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 Jul 07 18:05:36 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:37 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676" returned: 0 in 1.116s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:37 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676 Jul 07 18:05:37 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:37 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9" returned: 0 in 0.744s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d6c47da-7bd9-44b3-86b3-b24f9be6a323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f7ead3-ffeb-4d41-a9d1-ad78ad1e714d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:37 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Volume volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 (eecb4ebc-34f4-4879-a8a4-24265572d0a9): created successfully Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f7ead3-ffeb-4d41-a9d1-ad78ad1e714d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Flow 'volume_create_manager' (ee52aae5-6822-45d2-ac87-644fda5c81ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:37 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6cf36bfe-660c-4443-8ee2-9c55c85984e5 tempest-AttachVolumeNegativeTest-331721094 None] Created volume successfully. Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Flow 'volume_create_manager' (a0024392-7bc8-4f65-9495-acaf381d0bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3716ccff-c138-4f46-962b-28280c380baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3716ccff-c138-4f46-962b-28280c380baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-716725583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2769fd2a-09f9-4e3a-b22e-898117fb9f5f,host='devstack@QuobyteHD#QuobyteHD',id=aa9d50f0-5e04-4b62-91c6-66756a111cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c14b6684874344b710d6907e76dc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:37Z,use_quota=True,user_id='dc0d97f2effa4a6c8d17437dc23c1626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(120e3cd3-db77-4931-b5e8-69e0750c013e),volume_type_id=120e3cd3-db77-4931-b5e8-69e0750c013e)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0a1d49-6004-437b-95ed-355cddac2e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0a1d49-6004-437b-95ed-355cddac2e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f226bdfe-33fd-4a35-8ac2-bb8c123ec295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f226bdfe-33fd-4a35-8ac2-bb8c123ec295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9d50f0-5e04-4b62-91c6-66756a111cc0', 'volume_name': 'volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29383cf-fd40-4b51-93a1-81ea0d1346e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29383cf-fd40-4b51-93a1-81ea0d1346e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0475b70e-fbd7-45db-9c35-a94f92cfe742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:37 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Volume aa9d50f0-5e04-4b62-91c6-66756a111cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0', 'volume_size': 1} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2769fd2a-09f9-4e3a-b22e-898117fb9f5f,created_at=2026-07-07T16:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-716725583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2769fd2a-09f9-4e3a-b22e-898117fb9f5f,host='devstack@QuobyteHD#QuobyteHD',id=aa9d50f0-5e04-4b62-91c6-66756a111cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5c14b6684874344b710d6907e76dc91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:37Z,use_quota=True,user_id='dc0d97f2effa4a6c8d17437dc23c1626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(120e3cd3-db77-4931-b5e8-69e0750c013e),volume_type_id=120e3cd3-db77-4931-b5e8-69e0750c013e)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Creating volume aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:05:37 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:37 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 1073741824 Jul 07 18:05:37 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:37 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676" returned: 0 in 0.780s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Lock "cinder-quobyte-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676" released by "delete_volume" :: held 1.951s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Created reservations ['a8078072-cb37-4d21-bc98-02b9106d11a6', '3e407f61-38fe-4e54-a952-d8f7b221ef6b', '214f0ecd-300b-40a2-bb96-09332924b5b5', '1414f237-9b5d-4516-8ab0-5927c390faa9'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:38 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:05:38 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:38 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 1073741824" returned: 0 in 1.044s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:38 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 Jul 07 18:05:38 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:38 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.939s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:38 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:05:38 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Deleted volume successfully. Jul 07 18:05:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-98f247f1-4d2a-4d42-896f-773036f3d137 tempest-VolumesNegativeTest-345774003 None] Lock "cinder-ad7fbf51-4cdd-4a0a-9e33-73d97c5b6676-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:05:39 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0" returned: 0 in 0.818s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:05:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0475b70e-fbd7-45db-9c35-a94f92cfe742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f064e62d-21af-4c89-85ed-c2d41794dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:39 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Volume volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 (aa9d50f0-5e04-4b62-91c6-66756a111cc0): created successfully Jul 07 18:05:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f064e62d-21af-4c89-85ed-c2d41794dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Flow 'volume_create_manager' (a0024392-7bc8-4f65-9495-acaf381d0bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:39 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b9567679-1cae-4baa-ae74-f47c3bf00f83 tempest-GroupsV314Test-283198225 None] Created volume successfully. Jul 07 18:05:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-f6447a3d-a458-4f3c-b310-c9cbbeb1588c req-0330bb42-1aaf-4f01-b7a2-490e197e8552 tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-f6447a3d-a458-4f3c-b310-c9cbbeb1588c req-0330bb42-1aaf-4f01-b7a2-490e197e8552 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb5921-8334-4a70-9dca-bc99f7c31ff3]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-f6447a3d-a458-4f3c-b310-c9cbbeb1588c req-0330bb42-1aaf-4f01-b7a2-490e197e8552 tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:41 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 Jul 07 18:05:41 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:42 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-f6447a3d-a458-4f3c-b310-c9cbbeb1588c req-0330bb42-1aaf-4f01-b7a2-490e197e8552 tempest-AttachVolumeNegativeTest-331721094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9" returned: 0 in 0.839s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-f6447a3d-a458-4f3c-b310-c9cbbeb1588c req-0330bb42-1aaf-4f01-b7a2-490e197e8552 tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.819s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:42 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Cloning volume aa9d50f0-5e04-4b62-91c6-66756a111cc0 to volume 18b10702-6aa9-4222-b553-9701ba0133e0 Jul 07 18:05:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-f6447a3d-a458-4f3c-b310-c9cbbeb1588c req-0330bb42-1aaf-4f01-b7a2-490e197e8552 tempest-AttachVolumeNegativeTest-331721094 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2480b518-d452-4fca-8f78-8f648490fbfd', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:05:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Creating offline snapshot 36e1084e-1f45-4416-8c11-99052afe043b of volume aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:05:42 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94fa30f-179c-4aac-84df-bf69073645ed]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-f6447a3d-a458-4f3c-b310-c9cbbeb1588c req-0330bb42-1aaf-4f01-b7a2-490e197e8552 tempest-AttachVolumeNegativeTest-331721094 None] attachment_update completed successfully. Jul 07 18:05:42 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 Jul 07 18:05:42 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:43 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0" returned: 0 in 0.863s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:43 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b 1G Jul 07 18:05:43 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:44 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b 1G" returned: 0 in 1.156s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:44 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b Jul 07 18:05:44 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:45 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b" returned: 0 in 1.044s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:45 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:45 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b Jul 07 18:05:45 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:DELETE=9,cinder:SELECT=67,cinder:INSERT=23,cinder:UPDATE=87 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=84,cinder:SELECT=81,cinder:DELETE=3,cinder:INSERT=17 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Flow 'volume_create_manager' (f896a20c-28de-493b-a389-04a124d60377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d52f232-49e2-4d5c-af65-c63b52fbaa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d52f232-49e2-4d5c-af65-c63b52fbaa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a32a63-cdd4-4fd3-8995-8022b604755d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b488f85861e54fb7adc15109d6845545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:46Z,use_quota=True,user_id='eb49a0c7702a4d52bef112b32ae33790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50453e75-0887-4ae7-a42b-8a28de3668d3),volume_type_id=50453e75-0887-4ae7-a42b-8a28de3668d3)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c513d2f6-81c3-47de-8592-a01a9287ad0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c513d2f6-81c3-47de-8592-a01a9287ad0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabdb795-0632-48b9-9fdf-f1c36d8b03dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:45 devstack cinder-volume[86972]: DEBUG cinder.image.glance [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Creating Keystone auth plugin from conf {{(pid=86972) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:05:46 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b" returned: 0 in 1.026s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:46 devstack sudo[94270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.info Jul 07 18:05:46 devstack sudo[94270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabdb795-0632-48b9-9fdf-f1c36d8b03dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21a32a63-cdd4-4fd3-8995-8022b604755d', 'volume_name': 'volume-21a32a63-cdd4-4fd3-8995-8022b604755d', 'volume_size': 1, 'image_id': '3dac1183-2147-4ec8-852d-dccc42fd4466', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3dac1183-2147-4ec8-852d-dccc42fd4466', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '22423b3403ee050aa3527882d47e751e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b488f85861e54fb7adc15109d6845545', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4342d66cf916ce4ddcc92c898134ce517aa2efb7b6761a025d501dfe2ff1150d428b6c56ff7182da89bce53ebabe06b8c69e6526bbc291eff7dc69dad405635b', 'id': '3dac1183-2147-4ec8-852d-dccc42fd4466', 'created_at': datetime.datetime(2026, 7, 7, 16, 5, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 5, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3dac1183-2147-4ec8-852d-dccc42fd4466/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5708dc5c-d127-4dd8-aa0e-096fbc3fdcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5708dc5c-d127-4dd8-aa0e-096fbc3fdcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec87b4cc-9375-4697-a875-84df00a49cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:05:46 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Volume 21a32a63-cdd4-4fd3-8995-8022b604755d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21a32a63-cdd4-4fd3-8995-8022b604755d', 'volume_size': 1, 'image_id': '3dac1183-2147-4ec8-852d-dccc42fd4466', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3dac1183-2147-4ec8-852d-dccc42fd4466', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '22423b3403ee050aa3527882d47e751e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b488f85861e54fb7adc15109d6845545', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4342d66cf916ce4ddcc92c898134ce517aa2efb7b6761a025d501dfe2ff1150d428b6c56ff7182da89bce53ebabe06b8c69e6526bbc291eff7dc69dad405635b', 'id': '3dac1183-2147-4ec8-852d-dccc42fd4466', 'created_at': datetime.datetime(2026, 7, 7, 16, 5, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 5, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3dac1183-2147-4ec8-852d-dccc42fd4466/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Trying to clone 21a32a63-cdd4-4fd3-8995-8022b604755d from image 3dac1183-2147-4ec8-852d-dccc42fd4466 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3dac1183-2147-4ec8-852d-dccc42fd4466', 'metadata': {}}]). {{(pid=86972) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:05:46 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Image download 0.00 MB at 0.00 MB/s Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[af29c211-ba49-4fc4-b651-c6d91e7af1f9]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:46 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD Jul 07 18:05:46 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:47 devstack sudo[94270]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.info" returned: 0 in 0.799s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:47 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:47 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.info Jul 07 18:05:47 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:47 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:47 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD Jul 07 18:05:47 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:47 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.info" returned: 0 in 0.748s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Acquiring lock "cinder-quobyte-18b10702-6aa9-4222-b553-9701ba0133e0" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Lock "cinder-quobyte-18b10702-6aa9-4222-b553-9701ba0133e0" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] snapshot: 36e1084e-1f45-4416-8c11-99052afe043b, volume: 18b10702-6aa9-4222-b553-9701ba0133e0, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[148b6412-16c9-4acc-adaf-e721f0dcbc6b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:48 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b Jul 07 18:05:48 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:48 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD" returned: 1 in 0.812s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Temporary image 3dac1183-2147-4ec8-852d-dccc42fd4466 is fetched for user eb49a0c7702a4d52bef112b32ae33790. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf5f718-6517-48ba-a8de-cf1e2b4e4340]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:48 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD Jul 07 18:05:48 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:48 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b" returned: 0 in 0.829s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50e77fc-56e7-48ca-b3fb-2868fddec3bc]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:48 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 Jul 07 18:05:48 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:49 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-50ecf926-5456-4ba2-b87c-73986dfa54b1 req-34748c55-9652-4316-820d-dce5b1028227 tempest-AttachVolumeNegativeTest-331721094 None] Terminate volume connection completed successfully. Jul 07 18:05:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-50ecf926-5456-4ba2-b87c-73986dfa54b1 req-34748c55-9652-4316-820d-dce5b1028227 tempest-AttachVolumeNegativeTest-331721094 None] Deleting attachment 2480b518-d452-4fca-8f78-8f648490fbfd. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:05:49 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD" returned: 0 in 0.965s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:49 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD Jul 07 18:05:49 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:49 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0" returned: 0 in 1.177s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:49 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:05:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:50 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 Jul 07 18:05:50 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:50 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD" returned: 1 in 1.266s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:05:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:05:57 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0" returned: 0 in 7.565s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:57 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c07c74-7bbc-4d27-a4d5-ba25a5c44904]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:57 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 Jul 07 18:05:57 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:58 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0" returned: 0 in 1.369s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:58 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0, size 1024.00 MB, duration 7.57 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:05:58 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Converted 1024.00 MB image at 135.33 MB/s Jul 07 18:05:58 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 18:05:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:58 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 Jul 07 18:05:58 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:05:59 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Jul 07 18:05:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0" returned: 0 in 0.797s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:05:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Lock "cinder-quobyte-18b10702-6aa9-4222-b553-9701ba0133e0" released by "_copy_volume_from_snapshot" :: held 11.842s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:05:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Acquiring lock "cinder-quobyte-36e1084e-1f45-4416-8c11-99052afe043b" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:05:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Lock "cinder-quobyte-36e1084e-1f45-4416-8c11-99052afe043b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:05:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Deleting offline snapshot 36e1084e-1f45-4416-8c11-99052afe043b of volume aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:05:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] snapshot_file for this snap is: volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:05:59 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1e07ae-0db3-4b39-b903-37b4d7caa4f2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:05:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:05:59 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b Jul 07 18:05:59 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:00 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b" returned: 0 in 0.905s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:06:00 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a46c07a-53c6-4e9e-8e13-439a4783dd41]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:00 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 Jul 07 18:06:00 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:01 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0" returned: 0 in 0.827s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:01 devstack sudo[94494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b Jul 07 18:06:01 devstack sudo[94494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:01 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:06:02 devstack sudo[94494]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b" returned: 0 in 0.889s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:02 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b Jul 07 18:06:02 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:03 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0.36e1084e-1f45-4416-8c11-99052afe043b" returned: 0 in 0.864s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Lock "cinder-quobyte-36e1084e-1f45-4416-8c11-99052afe043b" released by "_delete_snapshot" :: held 3.600s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.309s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.733s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a32a63-cdd4-4fd3-8995-8022b604755d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b488f85861e54fb7adc15109d6845545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:05:46Z,use_quota=True,user_id='eb49a0c7702a4d52bef112b32ae33790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50453e75-0887-4ae7-a42b-8a28de3668d3),volume_type_id=50453e75-0887-4ae7-a42b-8a28de3668d3)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Creating volume 21a32a63-cdd4-4fd3-8995-8022b604755d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:03 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:03 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d 1073741824 Jul 07 18:06:03 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2b94d858-191d-4774-8ffd-d517fe5fded8 tempest-GroupsV314Test-283198225 None] Create group from source-group-2769fd2a-09f9-4e3a-b22e-898117fb9f5f completed successfully. Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "cinder-eecb4ebc-34f4-4879-a8a4-24265572d0a9-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-eecb4ebc-34f4-4879-a8a4-24265572d0a9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "cinder-quobyte-eecb4ebc-34f4-4879-a8a4-24265572d0a9" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-quobyte-eecb4ebc-34f4-4879-a8a4-24265572d0a9" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c1aa56-b856-41b7-986f-f311860cadb3]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:04 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 Jul 07 18:06:04 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:04 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d 1073741824" returned: 0 in 1.297s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:04 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d Jul 07 18:06:04 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Acquiring lock "cinder-quobyte-18b10702-6aa9-4222-b553-9701ba0133e0" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Lock "cinder-quobyte-18b10702-6aa9-4222-b553-9701ba0133e0" acquired by "delete_volume" :: waited 0.049s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:05 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9" returned: 0 in 1.605s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:05 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[918fdb43-468f-449c-b5c7-0747c1d2f75c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:05 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9 Jul 07 18:06:05 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:05 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 Jul 07 18:06:05 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:06 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d" returned: 0 in 1.831s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] <== create_volume: return (3223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.233s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:06 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:06 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Attempting download of 3dac1183-2147-4ec8-852d-dccc42fd4466 ((None, [{'url': 'file:///opt/stack/data/glance/images/3dac1183-2147-4ec8-852d-dccc42fd4466', 'metadata': {}}])) to volume 21a32a63-cdd4-4fd3-8995-8022b604755d. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:06:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-eecb4ebc-34f4-4879-a8a4-24265572d0a9" returned: 0 in 1.284s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-quobyte-eecb4ebc-34f4-4879-a8a4-24265572d0a9" released by "delete_volume" :: held 2.961s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:06 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[99068fdc-7d43-4e1b-b7a5-84da9069844d]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3dac1183-2147-4ec8-852d-dccc42fd4466_eaj7glt6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:06 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Created reservations ['1ffe1e89-535a-428e-81a5-b0aead9214df', '0f784e37-948c-4059-882a-45c40f32b627', '8228f7b8-d5e2-493b-93dc-f73ee032cda1', 'a48bf25a-687c-4141-9f4d-6e316d0c98bd'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:07 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0" returned: 0 in 1.535s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:07 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:07 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:07 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0 Jul 07 18:06:07 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:07 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3dac1183-2147-4ec8-852d-dccc42fd4466_eaj7glt6 Jul 07 18:06:07 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "cinder-412a077a-d929-4e0e-97b4-b438d8b102e0-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-412a077a-d929-4e0e-97b4-b438d8b102e0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "cinder-quobyte-412a077a-d929-4e0e-97b4-b438d8b102e0" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-quobyte-412a077a-d929-4e0e-97b4-b438d8b102e0" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c08fc7-70d7-4452-974a-1eb024b40ef7]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:08 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 Jul 07 18:06:08 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:08 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3dac1183-2147-4ec8-852d-dccc42fd4466_eaj7glt6" returned: 0 in 1.477s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3dac1183-2147-4ec8-852d-dccc42fd4466_eaj7glt6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:08 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.348s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Deleted volume successfully. Jul 07 18:06:08 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-18b10702-6aa9-4222-b553-9701ba0133e0" returned: 0 in 1.369s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5bf3d5e0-df88-4398-9da9-6db399d4693d tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-eecb4ebc-34f4-4879-a8a4-24265572d0a9-delete_volume" released by "delete_volume" :: held 4.690s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Lock "cinder-quobyte-18b10702-6aa9-4222-b553-9701ba0133e0" released by "delete_volume" :: held 3.012s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:08 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3dac1183-2147-4ec8-852d-dccc42fd4466_eaj7glt6 Jul 07 18:06:08 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Created reservations ['c0aec9bb-1eef-4fe9-b495-030890e1195d'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:08 devstack cinder-volume[86972]: WARNING cinder.quota [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-73542271 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-73542271, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:06:08 devstack cinder-volume[86972]: WARNING cinder.quota [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-73542271 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-73542271, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Created reservations ['1d1b86de-04bf-4cbd-8298-0e6f70cb6e73', '65883be3-7b91-4f14-925f-5280bfa68c6f', 'bb36547b-7df9-4eb8-915c-bfab752ce2a2', '59a6d98f-8f8f-422f-834c-3ecdef2419dc'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:08 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:08 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:08 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0" returned: 0 in 1.092s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:09 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0 Jul 07 18:06:09 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:09 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3dac1183-2147-4ec8-852d-dccc42fd4466_eaj7glt6" returned: 1 in 1.099s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3dac1183-2147-4ec8-852d-dccc42fd4466_eaj7glt6' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d7fb03-95c6-4507-9a90-a9091429d03a]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:09 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:09 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-7ff8553e-02c8-4227-8def-fc2ef01f9752 tempest-GroupsV314Test-283198225 None] Delete group completed successfully. Jul 07 18:06:09 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD Jul 07 18:06:09 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:09 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a077a-d929-4e0e-97b4-b438d8b102e0" returned: 0 in 0.777s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-quobyte-412a077a-d929-4e0e-97b4-b438d8b102e0" released by "delete_volume" :: held 1.951s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Acquiring lock "cinder-quobyte-aa9d50f0-5e04-4b62-91c6-66756a111cc0" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Lock "cinder-quobyte-aa9d50f0-5e04-4b62-91c6-66756a111cc0" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f48bcd-e8e7-43d1-8841-4ae1d01dbfb0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:09 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Created reservations ['5e7f455b-9d9f-492a-a202-187d4374769f', '714ddbbb-9a03-4395-aad9-7d13312c0811', '300406c4-b411-4c0f-9db8-2aeac87cfc9f', 'f2cc6f5b-f8c9-4646-bc8c-fcf42b70c7ee'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:10 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 Jul 07 18:06:10 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:10 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:10 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:10 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD" returned: 0 in 1.056s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:10 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD Jul 07 18:06:10 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:10 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.727s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Deleted volume successfully. Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d7f4805b-c924-4509-9cd4-828078e23f2b tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-412a077a-d929-4e0e-97b4-b438d8b102e0-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:10 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0" returned: 0 in 0.948s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:10 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0 Jul 07 18:06:10 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:11 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD" returned: 1 in 0.767s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] 3dac1183-2147-4ec8-852d-dccc42fd4466 was raw, converting to raw {{(pid=86972) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "cinder-5200d05b-f80c-4efb-8825-84586b54aa01-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:11 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d Jul 07 18:06:11 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-5200d05b-f80c-4efb-8825-84586b54aa01-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "cinder-quobyte-5200d05b-f80c-4efb-8825-84586b54aa01" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-quobyte-5200d05b-f80c-4efb-8825-84586b54aa01" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[643fb24c-9b37-423d-b107-b2b92e064e09]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:11 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 Jul 07 18:06:11 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:11 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-aa9d50f0-5e04-4b62-91c6-66756a111cc0" returned: 0 in 0.752s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Lock "cinder-quobyte-aa9d50f0-5e04-4b62-91c6-66756a111cc0" released by "delete_volume" :: held 1.851s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Created reservations ['119d2e5f-6f21-4f36-aeaa-15038be690c7'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:11 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Created reservations ['f21ee765-5af6-4a72-882c-c6a08db37a03', '1653ec01-8e70-42c3-9137-5a23bbbc4402', '1d4fb477-58c6-4236-84b0-9f33fd3d5878', '4e444dfd-36a5-4406-ab2b-10e7fdb528eb'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:12 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:12 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:12 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d" returned: 0 in 1.206s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3dac1183-2147-4ec8-852d-dccc42fd4466__wzq3e6idevstack@QuobyteHD, size 0.00 MB, duration 1.21 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:06:12 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:12 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d 1G Jul 07 18:06:12 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:12 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01" returned: 0 in 1.376s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:12 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01 Jul 07 18:06:12 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:12 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:12 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:13 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.090s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-44775acb-0e98-46a3-924c-f032190e6ac9 tempest-GroupsV314Test-283198225 None] Delete group completed successfully. Jul 07 18:06:13 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d 1G" returned: 0 in 1.302s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:13 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dafa18-f28e-49b3-936d-efc808592e9a]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:14 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5200d05b-f80c-4efb-8825-84586b54aa01" returned: 0 in 1.274s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-quobyte-5200d05b-f80c-4efb-8825-84586b54aa01" released by "delete_volume" :: held 2.711s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:14 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d Jul 07 18:06:14 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Created reservations ['45e5ab52-bdcf-4e39-8b05-329dd2fffd5c', '8a627205-0527-4e17-8db1-6f3ac1fb14a6', 'ab27b884-b918-47f8-8085-de74ae3bbc75', 'ddd65876-c6b7-41c6-9022-e966e3063464'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:14 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.389s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:14 devstack sudo[94682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:14 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:16 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d" returned: 0 in 2.137s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:16 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d Jul 07 18:06:16 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:16 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 2.154s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:16 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:16 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Deleted volume successfully. Jul 07 18:06:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-75d694b2-594f-4000-8d16-5097643b635e tempest-AttachVolumeNegativeTest-331721094 None] Lock "cinder-5200d05b-f80c-4efb-8825-84586b54aa01-delete_volume" released by "delete_volume" :: held 5.459s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:17 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d" returned: 1 in 1.662s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Downloaded image 3dac1183-2147-4ec8-852d-dccc42fd4466 ((None, [{'url': 'file:///opt/stack/data/glance/images/3dac1183-2147-4ec8-852d-dccc42fd4466', 'metadata': {}}])) to volume 21a32a63-cdd4-4fd3-8995-8022b604755d successfully. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Temporary image 3dac1183-2147-4ec8-852d-dccc42fd4466 for user eb49a0c7702a4d52bef112b32ae33790 is deleted. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Marking volume 21a32a63-cdd4-4fd3-8995-8022b604755d as bootable. {{(pid=86972) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Copying metadata from image 3dac1183-2147-4ec8-852d-dccc42fd4466 to 21a32a63-cdd4-4fd3-8995-8022b604755d. {{(pid=86972) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Creating volume glance metadata for volume 21a32a63-cdd4-4fd3-8995-8022b604755d backed by image 3dac1183-2147-4ec8-852d-dccc42fd4466 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3dac1183-2147-4ec8-852d-dccc42fd4466', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '22423b3403ee050aa3527882d47e751e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86972) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec87b4cc-9375-4697-a875-84df00a49cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a32a63-cdd4-4fd3-8995-8022b604755d', 'volume_size': 1, 'image_id': '3dac1183-2147-4ec8-852d-dccc42fd4466', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3dac1183-2147-4ec8-852d-dccc42fd4466', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '22423b3403ee050aa3527882d47e751e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b488f85861e54fb7adc15109d6845545', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4342d66cf916ce4ddcc92c898134ce517aa2efb7b6761a025d501dfe2ff1150d428b6c56ff7182da89bce53ebabe06b8c69e6526bbc291eff7dc69dad405635b', 'id': '3dac1183-2147-4ec8-852d-dccc42fd4466', 'created_at': datetime.datetime(2026, 7, 7, 16, 5, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 5, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3dac1183-2147-4ec8-852d-dccc42fd4466/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e54c3a-7f2e-4f07-9078-f4ceebc56aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:17 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Volume volume-21a32a63-cdd4-4fd3-8995-8022b604755d (21a32a63-cdd4-4fd3-8995-8022b604755d): created successfully Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e54c3a-7f2e-4f07-9078-f4ceebc56aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Flow 'volume_create_manager' (f896a20c-28de-493b-a389-04a124d60377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f3077f8b-fc90-4bdc-aa0c-d83e5f0ce055 tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Created volume successfully. Jul 07 18:06:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Acquiring lock "cinder-21a32a63-cdd4-4fd3-8995-8022b604755d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "cinder-21a32a63-cdd4-4fd3-8995-8022b604755d-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Acquiring lock "cinder-quobyte-21a32a63-cdd4-4fd3-8995-8022b604755d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "cinder-quobyte-21a32a63-cdd4-4fd3-8995-8022b604755d" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:18 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7978ba-588e-42cb-8c6e-dc91b3e9265a]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:19 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d Jul 07 18:06:19 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:20 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d" returned: 0 in 1.147s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:20 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d Jul 07 18:06:20 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:21 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d" returned: 1 in 1.177s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:06:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:21 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d Jul 07 18:06:21 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:22 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-21a32a63-cdd4-4fd3-8995-8022b604755d" returned: 0 in 1.003s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "cinder-quobyte-21a32a63-cdd4-4fd3-8995-8022b604755d" released by "delete_volume" :: held 3.467s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:22 devstack cinder-volume[86972]: WARNING cinder.quota [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:06:22 devstack cinder-volume[86972]: WARNING cinder.quota [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:06:22 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Created reservations ['35bda4d7-0959-48d5-97f1-0929fe15eb79', '59d89bb2-7ef0-4e72-b606-d43acd9ac072', 'fb13b78e-f1ad-44c1-b84e-e485d46b7b78', '3e0f97a4-bdf6-4f8b-9d32-ec2a15315d0f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:22 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:22 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:23 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.904s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:23 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Deleted volume successfully. Jul 07 18:06:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fb714417-8f0b-4e18-82f4-e4f0f2abb02a tempest-VolumeAndVolumeTypeFromImageTest-397230816 None] Lock "cinder-21a32a63-cdd4-4fd3-8995-8022b604755d-delete_volume" released by "delete_volume" :: held 4.748s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Flow 'volume_create_manager' (0f187c84-ba9e-4337-a679-d2c297a3c51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdd5a1a-92ea-4a5f-8ba6-99196af19c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbdd5a1a-92ea-4a5f-8ba6-99196af19c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1020617843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f816343c-a20e-4823-a864-43cee1d8d31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476ff62c994648c186d1c375474bb062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:27Z,use_quota=True,user_id='1c4114c92c53494cafa0c9111ab6ba1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc12e60-cbab-4949-ba22-fb544dac3e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc12e60-cbab-4949-ba22-fb544dac3e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788e3de2-fd0b-4f0b-a56d-f77741053088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788e3de2-fd0b-4f0b-a56d-f77741053088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f816343c-a20e-4823-a864-43cee1d8d31a', 'volume_name': 'volume-f816343c-a20e-4823-a864-43cee1d8d31a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d41807-e4ae-4cd0-864f-758580a5d862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d41807-e4ae-4cd0-864f-758580a5d862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823b946f-0a3d-4108-912e-dd116b83d6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:27 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Volume f816343c-a20e-4823-a864-43cee1d8d31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f816343c-a20e-4823-a864-43cee1d8d31a', 'volume_size': 1} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1020617843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f816343c-a20e-4823-a864-43cee1d8d31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476ff62c994648c186d1c375474bb062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:27Z,use_quota=True,user_id='1c4114c92c53494cafa0c9111ab6ba1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Creating volume f816343c-a20e-4823-a864-43cee1d8d31a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:27 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:27 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a 1073741824 Jul 07 18:06:27 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:28 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a 1073741824" returned: 0 in 1.062s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:28 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a Jul 07 18:06:28 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:29 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a" returned: 0 in 0.760s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823b946f-0a3d-4108-912e-dd116b83d6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f816343c-a20e-4823-a864-43cee1d8d31a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16eaad21-b719-4c47-ad3a-4c08781376ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:29 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Volume volume-f816343c-a20e-4823-a864-43cee1d8d31a (f816343c-a20e-4823-a864-43cee1d8d31a): created successfully Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16eaad21-b719-4c47-ad3a-4c08781376ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Flow 'volume_create_manager' (0f187c84-ba9e-4337-a679-d2c297a3c51f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:29 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fcf7fbf0-f444-44dc-93f6-e4f69141d230 tempest-ServersNegativeTestJSON-634868604 None] Created volume successfully. Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (cc4e64fc-1f0e-46cc-af4f-7f02ea20537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b75463-368c-4a1f-82d2-db618294f663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b75463-368c-4a1f-82d2-db618294f663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1512040951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae74316d-1146-4a3d-a857-1a722f6c7b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:30Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ad4762-2bd5-48f7-9b1f-4bf579114a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ad4762-2bd5-48f7-9b1f-4bf579114a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a7022d-de87-4bcd-b509-03e2f524e20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a7022d-de87-4bcd-b509-03e2f524e20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae74316d-1146-4a3d-a857-1a722f6c7b32', 'volume_name': 'volume-ae74316d-1146-4a3d-a857-1a722f6c7b32', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669a1427-a55b-4854-9ed6-41d949c2dd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669a1427-a55b-4854-9ed6-41d949c2dd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b13f7e0-18d0-4340-9cd3-f23aef9744b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:30 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume ae74316d-1146-4a3d-a857-1a722f6c7b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae74316d-1146-4a3d-a857-1a722f6c7b32', 'volume_size': 1} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1512040951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae74316d-1146-4a3d-a857-1a722f6c7b32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:30Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Creating volume ae74316d-1146-4a3d-a857-1a722f6c7b32 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:30 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:30 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 1073741824 Jul 07 18:06:30 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:31 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 1073741824" returned: 0 in 1.063s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:31 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 Jul 07 18:06:31 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:32 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32" returned: 0 in 0.964s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b13f7e0-18d0-4340-9cd3-f23aef9744b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae74316d-1146-4a3d-a857-1a722f6c7b32', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0840a946-1ce9-4348-96d3-d33e9c645bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:32 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 (ae74316d-1146-4a3d-a857-1a722f6c7b32): created successfully Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0840a946-1ce9-4348-96d3-d33e9c645bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (cc4e64fc-1f0e-46cc-af4f-7f02ea20537f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:32 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dfdc30ec-f08e-4cab-9e07-e8e19cabe51d tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created volume successfully. Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Flow 'volume_create_manager' (469f8422-65e2-4cfe-a6a1-20524008687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dbecf9-f334-4987-bfe6-c82059caae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50dbecf9-f334-4987-bfe6-c82059caae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1219918904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de5e464-c11e-4379-8caf-5ad963080d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476ff62c994648c186d1c375474bb062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:32Z,use_quota=True,user_id='1c4114c92c53494cafa0c9111ab6ba1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672fd821-24d1-41ee-a1aa-e13af80acfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672fd821-24d1-41ee-a1aa-e13af80acfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339d2c6a-7288-4dfb-aed9-8181b18436cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (339d2c6a-7288-4dfb-aed9-8181b18436cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de5e464-c11e-4379-8caf-5ad963080d03', 'volume_name': 'volume-6de5e464-c11e-4379-8caf-5ad963080d03', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e35a0a-fe74-4508-86a9-ff0b8b51ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e35a0a-fe74-4508-86a9-ff0b8b51ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab2ce80-5677-4411-9f1c-9fc71e7f8541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:32 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Volume 6de5e464-c11e-4379-8caf-5ad963080d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de5e464-c11e-4379-8caf-5ad963080d03', 'volume_size': 1} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1219918904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de5e464-c11e-4379-8caf-5ad963080d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476ff62c994648c186d1c375474bb062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:32Z,use_quota=True,user_id='1c4114c92c53494cafa0c9111ab6ba1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Creating volume 6de5e464-c11e-4379-8caf-5ad963080d03 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:32 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:32 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03 1073741824 Jul 07 18:06:32 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:33 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03 1073741824" returned: 0 in 1.307s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (984bd959-2f8e-419a-80cf-4b4571c55fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882025e2-40c3-4d99-a1ab-6117aa8daef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:34 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03 Jul 07 18:06:34 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882025e2-40c3-4d99-a1ab-6117aa8daef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402739843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0511d432-d66c-4f7f-b3d3-b7848e5fabbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:34Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69de5bca-9c83-4b9e-bc49-915d464ca514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69de5bca-9c83-4b9e-bc49-915d464ca514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04103b14-7684-42a2-81a0-2cd3557f386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04103b14-7684-42a2-81a0-2cd3557f386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0511d432-d66c-4f7f-b3d3-b7848e5fabbd', 'volume_name': 'volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e578d518-4a07-447b-8a87-e94d2899398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e578d518-4a07-447b-8a87-e94d2899398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443093e8-f830-4dd8-aef2-dd010581d3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume 0511d432-d66c-4f7f-b3d3-b7848e5fabbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd', 'volume_size': 1} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (8c4d8c4a-28e7-472d-9128-750a2d1aec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f85c3a-8c3e-4754-9ed0-e750933fc2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f85c3a-8c3e-4754-9ed0-e750933fc2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855259235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7c856d-7c7d-435c-96da-fcde13534558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:34Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a5bdc4-abe2-4060-b54d-9da174d982da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a5bdc4-abe2-4060-b54d-9da174d982da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71aedf6-d0d1-49df-a450-b899a54c6d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71aedf6-d0d1-49df-a450-b899a54c6d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7c856d-7c7d-435c-96da-fcde13534558', 'volume_name': 'volume-0a7c856d-7c7d-435c-96da-fcde13534558', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c6c76b-a1c7-4dc2-a4c0-25b28ee9fb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c6c76b-a1c7-4dc2-a4c0-25b28ee9fb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3401c0aa-ab45-4361-8646-59190cd3f24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:34 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume 0a7c856d-7c7d-435c-96da-fcde13534558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7c856d-7c7d-435c-96da-fcde13534558', 'volume_size': 1} Jul 07 18:06:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:35 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03" returned: 0 in 0.996s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] <== create_volume: return (2440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.443s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402739843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0511d432-d66c-4f7f-b3d3-b7848e5fabbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:34Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Creating volume 0511d432-d66c-4f7f-b3d3-b7848e5fabbd {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:35 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:35 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd 1073741824 Jul 07 18:06:35 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab2ce80-5677-4411-9f1c-9fc71e7f8541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de5e464-c11e-4379-8caf-5ad963080d03', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd51c9dd-a948-4d2c-9224-8788e432c971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Volume volume-6de5e464-c11e-4379-8caf-5ad963080d03 (6de5e464-c11e-4379-8caf-5ad963080d03): created successfully Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd51c9dd-a948-4d2c-9224-8788e432c971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Flow 'volume_create_manager' (469f8422-65e2-4cfe-a6a1-20524008687e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-65f62817-7874-4660-8cd4-ee179ebf080f tempest-ServersNegativeTestJSON-634868604 None] Created volume successfully. Jul 07 18:06:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-67cebfe0-751c-450e-a883-d88f2e7db6d7 tempest-GroupsTest-138479430 None] Group tempest-Group1-281249948: creating Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (63119001-9092-4d36-a00d-63ef262b9bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b566e3c-551f-48c3-b7f8-98774d2979bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b566e3c-551f-48c3-b7f8-98774d2979bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858108272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1a2f47-1a75-4cce-aa4b-226af0d038b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:35Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9a4051-a33c-4918-9dc1-cc492ea19bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9a4051-a33c-4918-9dc1-cc492ea19bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef4f8b3-27b4-4754-b21f-e1b88af7fd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef4f8b3-27b4-4754-b21f-e1b88af7fd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1a2f47-1a75-4cce-aa4b-226af0d038b9', 'volume_name': 'volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e05f4d-7eed-481c-97c2-e9acace51e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e05f4d-7eed-481c-97c2-e9acace51e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16486c65-8ba8-402c-8672-554c6f4d88f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume cb1a2f47-1a75-4cce-aa4b-226af0d038b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9', 'volume_size': 1} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-67cebfe0-751c-450e-a883-d88f2e7db6d7 tempest-GroupsTest-138479430 None] Group tempest-Group1-281249948: created successfully Jul 07 18:06:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-67cebfe0-751c-450e-a883-d88f2e7db6d7 tempest-GroupsTest-138479430 None] Create group completed successfully. Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (098198c7-9f45-4963-9957-441ddeac7fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9e1910-d0b5-46c2-8924-91ffc4c46f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9e1910-d0b5-46c2-8924-91ffc4c46f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-509245353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179f20ae-3f44-4586-90bf-6933fb8e55a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:35Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d71e051-d96a-43bc-a5b3-aa1d306e19b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d71e051-d96a-43bc-a5b3-aa1d306e19b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff232b2-3b64-44c2-a0fb-a9f14857813a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff232b2-3b64-44c2-a0fb-a9f14857813a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179f20ae-3f44-4586-90bf-6933fb8e55a0', 'volume_name': 'volume-179f20ae-3f44-4586-90bf-6933fb8e55a0', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af62a24d-bb9f-41b2-a3b3-056eecf80cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af62a24d-bb9f-41b2-a3b3-056eecf80cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a73fef-4a34-4a92-b1cf-3d4662fc0269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume 179f20ae-3f44-4586-90bf-6933fb8e55a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179f20ae-3f44-4586-90bf-6933fb8e55a0', 'volume_size': 1} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (739ffdbd-60c5-4914-9f61-52ed97053179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661b489d-fdfc-41a3-a192-57ed648c1463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661b489d-fdfc-41a3-a192-57ed648c1463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2028024900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4895961d-0921-491c-831f-fa31455eaa9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:36Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b085bba2-8246-4207-83f5-0b3bdc464c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b085bba2-8246-4207-83f5-0b3bdc464c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd6fa44-5585-4efc-9d34-91fbe1e32f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd6fa44-5585-4efc-9d34-91fbe1e32f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4895961d-0921-491c-831f-fa31455eaa9d', 'volume_name': 'volume-4895961d-0921-491c-831f-fa31455eaa9d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbbacf9-3fcf-4c81-9d5b-0b19f9cbbc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbbacf9-3fcf-4c81-9d5b-0b19f9cbbc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab10b2b4-01a7-4dc9-bdc7-2d01af7fb39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume 4895961d-0921-491c-831f-fa31455eaa9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4895961d-0921-491c-831f-fa31455eaa9d', 'volume_size': 1} Jul 07 18:06:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:36 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1b45ed3c-312a-453f-9ebb-a45187f8e6fb tempest-GroupsTest-138479430 None] Group tempest-Group2-960465080: creating Jul 07 18:06:36 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1b45ed3c-312a-453f-9ebb-a45187f8e6fb tempest-GroupsTest-138479430 None] Group tempest-Group2-960465080: created successfully Jul 07 18:06:36 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1b45ed3c-312a-453f-9ebb-a45187f8e6fb tempest-GroupsTest-138479430 None] Create group completed successfully. Jul 07 18:06:36 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd 1073741824" returned: 0 in 1.313s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "cinder-6de5e464-c11e-4379-8caf-5ad963080d03-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Lock "cinder-6de5e464-c11e-4379-8caf-5ad963080d03-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "cinder-quobyte-6de5e464-c11e-4379-8caf-5ad963080d03" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:36 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd Jul 07 18:06:36 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Lock "cinder-quobyte-6de5e464-c11e-4379-8caf-5ad963080d03" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1328129-730b-4d88-840f-379d9199b7d2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:36 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03 Jul 07 18:06:36 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:37 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd" returned: 0 in 0.692s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.647s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855259235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7c856d-7c7d-435c-96da-fcde13534558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:34Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Creating volume 0a7c856d-7c7d-435c-96da-fcde13534558 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:37 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:37 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558 1073741824 Jul 07 18:06:37 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443093e8-f830-4dd8-aef2-dd010581d3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbbd6fd-4185-4cc6-ac56-3ae1c42741f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:37 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd (0511d432-d66c-4f7f-b3d3-b7848e5fabbd): created successfully Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbbd6fd-4185-4cc6-ac56-3ae1c42741f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (984bd959-2f8e-419a-80cf-4b4571c55fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:37 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-319b636a-8337-496a-ac69-d20127839023 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created volume successfully. Jul 07 18:06:37 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03" returned: 0 in 0.918s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:37 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03 Jul 07 18:06:37 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Flow 'volume_create_manager' (917fb40a-5c57-43c8-882f-f2080d22141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef289cc-8fd3-497b-b470-7204026115e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef289cc-8fd3-497b-b470-7204026115e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-337006974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cf7373-c8e0-4417-bb0b-cc93cda995e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd75981fd0d46808241febe3fb967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:38Z,use_quota=True,user_id='ecf0fdf00d7949aaad3c178f4a0d07fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(761aafb1-46ab-4234-9b6a-ef9fa695149b),volume_type_id=761aafb1-46ab-4234-9b6a-ef9fa695149b)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aac87d1-3b75-4744-80df-2f32a05ab1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aac87d1-3b75-4744-80df-2f32a05ab1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9794bf-663d-4fd4-a340-a809f7acfe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9794bf-663d-4fd4-a340-a809f7acfe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5cf7373-c8e0-4417-bb0b-cc93cda995e9', 'volume_name': 'volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff02deb-fdfc-4333-801b-2fcc437f9b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff02deb-fdfc-4333-801b-2fcc437f9b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7373f142-c72c-4c2d-9569-13f5a4e622d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:37 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Volume b5cf7373-c8e0-4417-bb0b-cc93cda995e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9', 'volume_size': 1} Jul 07 18:06:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Flow 'volume_create_manager' (0b125dc8-a2c8-4bdd-9bec-aaadc80df5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6752f990-a8aa-4de1-bc23-1a980ff6338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6752f990-a8aa-4de1-bc23-1a980ff6338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271763660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6782dadb-f25c-4cad-8fdb-20f27bb1ad7c,host='devstack@QuobyteHD#QuobyteHD',id=2cc71b0d-527b-4fc7-adb5-c43284a0dbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237a2f181141461db53d113ad4d4e714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:38Z,use_quota=True,user_id='9ff16c7005fc4f749373febe72964d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03328863-e46f-4f03-a66a-4579e06ecf85),volume_type_id=03328863-e46f-4f03-a66a-4579e06ecf85)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4339ae4d-6a78-4513-bbed-66be83e822fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4339ae4d-6a78-4513-bbed-66be83e822fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d29680b-e4d9-43f3-81af-447bb7612e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d29680b-e4d9-43f3-81af-447bb7612e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc71b0d-527b-4fc7-adb5-c43284a0dbb9', 'volume_name': 'volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18aff2a5-7ed4-4b43-b719-54f941f398f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18aff2a5-7ed4-4b43-b719-54f941f398f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:38 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49750ece-859d-4028-a63b-b13b88e5f22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:38 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Volume 2cc71b0d-527b-4fc7-adb5-c43284a0dbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9', 'volume_size': 1} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558 1073741824" returned: 0 in 1.088s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:38 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558 Jul 07 18:06:38 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:38 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6de5e464-c11e-4379-8caf-5ad963080d03" returned: 0 in 0.917s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Lock "cinder-quobyte-6de5e464-c11e-4379-8caf-5ad963080d03" released by "delete_volume" :: held 1.884s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Created reservations ['ea006be0-d28b-4d5e-b709-f17b2858b7fe', 'edeb387a-1a1c-46be-b783-fa8e24875f8c', 'b3cb2764-2338-43b8-90db-ae85fbec0881', '2933a2a6-fce9-4f38-bfe2-bd1aa74a39c7'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:38 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:38 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "cinder-f816343c-a20e-4823-a864-43cee1d8d31a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Lock "cinder-f816343c-a20e-4823-a864-43cee1d8d31a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "cinder-quobyte-f816343c-a20e-4823-a864-43cee1d8d31a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Lock "cinder-quobyte-f816343c-a20e-4823-a864-43cee1d8d31a" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa6a583-3e85-4225-a395-cb752c0b0cbc]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:39 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a Jul 07 18:06:39 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:39 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558" returned: 0 in 0.813s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.739s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858108272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1a2f47-1a75-4cce-aa4b-226af0d038b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:35Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Creating volume cb1a2f47-1a75-4cce-aa4b-226af0d038b9 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:39 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:39 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 1073741824 Jul 07 18:06:39 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3401c0aa-ab45-4361-8646-59190cd3f24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7c856d-7c7d-435c-96da-fcde13534558', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7fca15-3d40-42c2-9e85-dbc2ccabb652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:39 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume volume-0a7c856d-7c7d-435c-96da-fcde13534558 (0a7c856d-7c7d-435c-96da-fcde13534558): created successfully Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7fca15-3d40-42c2-9e85-dbc2ccabb652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (8c4d8c4a-28e7-472d-9128-750a2d1aec5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:39 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-65b1db04-3305-43a6-b555-4253a62c6b09 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created volume successfully. Jul 07 18:06:39 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.951s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:39 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Deleted volume successfully. Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e69c4067-92d3-4fa4-b0f8-6b44c0dd1eba tempest-ServersNegativeTestJSON-634868604 None] Lock "cinder-6de5e464-c11e-4379-8caf-5ad963080d03-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:39 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a" returned: 0 in 0.897s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:39 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a Jul 07 18:06:39 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:40 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 1073741824" returned: 0 in 0.832s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:40 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 Jul 07 18:06:40 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:40 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f816343c-a20e-4823-a864-43cee1d8d31a" returned: 0 in 0.669s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Lock "cinder-quobyte-f816343c-a20e-4823-a864-43cee1d8d31a" released by "delete_volume" :: held 1.627s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Created reservations ['d8fba90e-2c0c-41e8-bf7b-c0d2d9774dda', '95e0e12a-3765-4c0e-a1b6-edee71066d21', '2057276a-c3a5-4646-9ba0-ffaa1b299d19', '5208ea9a-6d6c-464d-9976-45889fbf799a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:40 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9" returned: 0 in 0.666s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.083s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-509245353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=179f20ae-3f44-4586-90bf-6933fb8e55a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:35Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Creating volume 179f20ae-3f44-4586-90bf-6933fb8e55a0 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:40 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:40 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:40 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:40 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 1073741824 Jul 07 18:06:40 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16486c65-8ba8-402c-8672-554c6f4d88f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d078cf8-a9b1-412e-9be4-4e5d7d717df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:40 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 (cb1a2f47-1a75-4cce-aa4b-226af0d038b9): created successfully Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d078cf8-a9b1-412e-9be4-4e5d7d717df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (63119001-9092-4d36-a00d-63ef262b9bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0f68e2bd-14d9-4bd2-bdea-e4746d2ac298 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created volume successfully. Jul 07 18:06:41 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.734s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:41 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:41 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Deleted volume successfully. Jul 07 18:06:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61f1042c-8e96-4ad1-a8ca-8899f3239bdb tempest-ServersNegativeTestJSON-634868604 None] Lock "cinder-f816343c-a20e-4823-a864-43cee1d8d31a-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:41 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 1073741824" returned: 0 in 0.938s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:41 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 Jul 07 18:06:41 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:42 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0" returned: 0 in 0.624s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.351s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2028024900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4895961d-0921-491c-831f-fa31455eaa9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c89c667e2e641ab8c98b6d01a7e2fe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:36Z,use_quota=True,user_id='9d28b0796625498a906ee2c05827e0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Creating volume 4895961d-0921-491c-831f-fa31455eaa9d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:42 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a73fef-4a34-4a92-b1cf-3d4662fc0269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179f20ae-3f44-4586-90bf-6933fb8e55a0', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00456706-fcd8-4a7f-8299-463f4e8b6dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:42 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d 1073741824 Jul 07 18:06:42 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:42 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 (179f20ae-3f44-4586-90bf-6933fb8e55a0): created successfully Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00456706-fcd8-4a7f-8299-463f4e8b6dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (098198c7-9f45-4963-9957-441ddeac7fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ea51ee3b-415b-424a-98c9-88a64aca482c tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created volume successfully. Jul 07 18:06:43 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d 1073741824" returned: 0 in 1.053s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:43 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d Jul 07 18:06:43 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:44 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d" returned: 0 in 0.747s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.459s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-337006974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5cf7373-c8e0-4417-bb0b-cc93cda995e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd75981fd0d46808241febe3fb967ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:38Z,use_quota=True,user_id='ecf0fdf00d7949aaad3c178f4a0d07fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(761aafb1-46ab-4234-9b6a-ef9fa695149b),volume_type_id=761aafb1-46ab-4234-9b6a-ef9fa695149b)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Creating volume b5cf7373-c8e0-4417-bb0b-cc93cda995e9 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:44 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:44 devstack sudo[94904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 1073741824 Jul 07 18:06:44 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab10b2b4-01a7-4dc9-bdc7-2d01af7fb39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4895961d-0921-491c-831f-fa31455eaa9d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9439eea-7137-43f0-9425-a473850d8c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:44 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Volume volume-4895961d-0921-491c-831f-fa31455eaa9d (4895961d-0921-491c-831f-fa31455eaa9d): created successfully Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9439eea-7137-43f0-9425-a473850d8c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Flow 'volume_create_manager' (739ffdbd-60c5-4914-9f61-52ed97053179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6e97e214-70cc-4546-a633-4a32eb66810a tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created volume successfully. Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-4895961d-0921-491c-831f-fa31455eaa9d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-4895961d-0921-491c-831f-fa31455eaa9d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-quobyte-4895961d-0921-491c-831f-fa31455eaa9d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-4895961d-0921-491c-831f-fa31455eaa9d" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0499a2db-5195-4c54-954b-af30a16f8e15]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:44 devstack sudo[94910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d Jul 07 18:06:44 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:45 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 1073741824" returned: 0 in 0.897s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:45 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 Jul 07 18:06:45 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:45 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d" returned: 0 in 0.804s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:45 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d Jul 07 18:06:45 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:45 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9" returned: 0 in 0.773s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.669s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6782dadb-f25c-4cad-8fdb-20f27bb1ad7c,created_at=2026-07-07T16:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271763660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6782dadb-f25c-4cad-8fdb-20f27bb1ad7c,host='devstack@QuobyteHD#QuobyteHD',id=2cc71b0d-527b-4fc7-adb5-c43284a0dbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237a2f181141461db53d113ad4d4e714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:38Z,use_quota=True,user_id='9ff16c7005fc4f749373febe72964d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03328863-e46f-4f03-a66a-4579e06ecf85),volume_type_id=03328863-e46f-4f03-a66a-4579e06ecf85)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Creating volume 2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:45 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:45 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 1073741824 Jul 07 18:06:45 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7373f142-c72c-4c2d-9569-13f5a4e622d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e151f8-b8a5-4ab7-8481-27f60540aab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:46 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Volume volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 (b5cf7373-c8e0-4417-bb0b-cc93cda995e9): created successfully Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e151f8-b8a5-4ab7-8481-27f60540aab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Flow 'volume_create_manager' (917fb40a-5c57-43c8-882f-f2080d22141d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=77,cinder:INSERT=31,cinder:UPDATE=105,cinder:DELETE=9 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:06:46 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ac7cbd67-46d8-48eb-adc6-dbbfc6b507c4 tempest-VolumeTypesAccessTest-1975490636 None] Created volume successfully. Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Acquiring lock "cinder-b5cf7373-c8e0-4417-bb0b-cc93cda995e9-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Lock "cinder-b5cf7373-c8e0-4417-bb0b-cc93cda995e9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Acquiring lock "cinder-quobyte-b5cf7373-c8e0-4417-bb0b-cc93cda995e9" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Lock "cinder-quobyte-b5cf7373-c8e0-4417-bb0b-cc93cda995e9" acquired by "delete_volume" :: waited 0.031s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b1028d-6573-41cb-9b88-d6dbee6b2ea8]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:46 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4895961d-0921-491c-831f-fa31455eaa9d" returned: 0 in 0.872s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-4895961d-0921-491c-831f-fa31455eaa9d" released by "delete_volume" :: held 1.722s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created reservations ['9d1e23a3-5ade-4c83-b7a8-5914b16e36ba', '6fb2e2c7-f5a9-4205-be8f-871ffd1902c9', '0bac8557-100e-40e1-99cd-1b5de9b518c7', '03fff233-6d11-4e69-b2f2-34c58d34cd36'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:46 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 Jul 07 18:06:46 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:46 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:46 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-179f20ae-3f44-4586-90bf-6933fb8e55a0-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:47 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 1073741824" returned: 0 in 1.161s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-179f20ae-3f44-4586-90bf-6933fb8e55a0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-quobyte-179f20ae-3f44-4586-90bf-6933fb8e55a0" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-179f20ae-3f44-4586-90bf-6933fb8e55a0" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:47 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 Jul 07 18:06:47 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0308bef4-f8d9-4fbd-8712-d2052029633c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:47 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9" returned: 0 in 0.943s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:47 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9 Jul 07 18:06:47 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:47 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.742s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:47 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Deleted volume successfully. Jul 07 18:06:47 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 Jul 07 18:06:47 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66301b8-d2e7-4e96-95a1-7004f1111dee tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-4895961d-0921-491c-831f-fa31455eaa9d-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:48 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9" returned: 0 in 0.869s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49750ece-859d-4028-a63b-b13b88e5f22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe62ed9a-8c53-488d-9951-93d595ebc4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:48 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Volume volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 (2cc71b0d-527b-4fc7-adb5-c43284a0dbb9): created successfully Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe62ed9a-8c53-488d-9951-93d595ebc4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Flow 'volume_create_manager' (0b125dc8-a2c8-4bdd-9bec-aaadc80df5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:48 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-de47411b-bbd7-4fb7-b858-cd2eaea541e5 tempest-GroupsTest-138479430 None] Created volume successfully. Jul 07 18:06:48 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b5cf7373-c8e0-4417-bb0b-cc93cda995e9" returned: 0 in 0.804s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Lock "cinder-quobyte-b5cf7373-c8e0-4417-bb0b-cc93cda995e9" released by "delete_volume" :: held 1.821s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:48 devstack cinder-volume[86972]: WARNING cinder.quota [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1710258799 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1710258799, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:06:48 devstack cinder-volume[86972]: WARNING cinder.quota [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1710258799 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1710258799, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Created reservations ['0a2970af-bb7a-40fb-8032-06b98be38c94', 'bce20afb-f5c2-45eb-8422-1bdc571025a4', 'ffb98b03-c74d-4c17-a2a3-b9d0477288d0', 'b6b894e5-cfe5-4d32-972a-418b0e7af9dc'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:48 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0" returned: 0 in 1.057s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:48 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0 Jul 07 18:06:48 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:48 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:48 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:49 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-179f20ae-3f44-4586-90bf-6933fb8e55a0" returned: 0 in 0.907s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-179f20ae-3f44-4586-90bf-6933fb8e55a0" released by "delete_volume" :: held 2.029s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:49 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.931s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:49 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Deleted volume successfully. Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51da29e2-ebed-4690-9506-2bd3c83a8f8b tempest-VolumeTypesAccessTest-1975490636 None] Lock "cinder-b5cf7373-c8e0-4417-bb0b-cc93cda995e9-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created reservations ['6056b50f-c3f4-48b2-ab95-c7488ecb3b21', '9335cdc2-4c56-4459-b24d-d247dd2d1247', 'edc0e6f7-539b-4d9f-8e6b-d9fa6d3969e1', '3839ed0c-a3cf-4d89-a096-73f971737578'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:49 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:49 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Acquiring lock "cinder-quobyte-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Lock "cinder-quobyte-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9" acquired by "delete_volume" :: waited 0.031s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9872cf7-6601-4e89-8ad8-1942aa59204c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:50 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 Jul 07 18:06:50 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:50 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.020s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:50 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Deleted volume successfully. Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-cb1a2f47-1a75-4cce-aa4b-226af0d038b9-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-cb1a2f47-1a75-4cce-aa4b-226af0d038b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d811948d-515e-49d2-89e4-7e7f3f5630ef tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-179f20ae-3f44-4586-90bf-6933fb8e55a0-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-quobyte-cb1a2f47-1a75-4cce-aa4b-226af0d038b9" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-cb1a2f47-1a75-4cce-aa4b-226af0d038b9" acquired by "delete_volume" :: waited 0.030s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5806c65-a772-4758-8fa8-d2c99c843a02]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:50 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 Jul 07 18:06:50 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:51 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9" returned: 0 in 1.261s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:51 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9 Jul 07 18:06:51 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:51 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9" returned: 0 in 1.132s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:51 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9 Jul 07 18:06:51 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:52 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9" returned: 0 in 0.963s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Lock "cinder-quobyte-2cc71b0d-527b-4fc7-adb5-c43284a0dbb9" released by "delete_volume" :: held 2.324s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Created reservations ['679920a7-c6da-4f88-b6fa-908e409ad623'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:52 devstack cinder-volume[86972]: WARNING cinder.quota [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1818024192 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1818024192, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:06:52 devstack cinder-volume[86972]: WARNING cinder.quota [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1818024192 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1818024192, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Created reservations ['23523eb6-7e0b-4dc5-8b76-7a936a755805', '4d290850-6090-4da6-ba93-28e8d98e851f', 'e4b80d94-390d-4cb3-9c6b-2ef233ca85b6', '33d7145b-8eff-4855-b966-3c8d6538d6b8'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:52 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:52 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:52 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cb1a2f47-1a75-4cce-aa4b-226af0d038b9" returned: 0 in 1.077s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-cb1a2f47-1a75-4cce-aa4b-226af0d038b9" released by "delete_volume" :: held 2.284s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] Created reservations ['633a9b86-dc95-409f-abc7-9ee14c178a9e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created reservations ['70c21b12-1701-42e1-9f6b-8bf07104636a', '62bbc44d-1858-440c-a30b-7a125c826ea7', 'f9dc98fd-2a43-4b1d-9093-249794073966', '9ca660b4-9edf-44f7-9bc5-c18830f8a82e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:53 devstack sudo[94977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:53 devstack sudo[94977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:53 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:53 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:53 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.109s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:53 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3658d395-c190-4cf9-ac28-218933c7a531 tempest-GroupsTest-138479430 None] Delete group completed successfully. Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-0a7c856d-7c7d-435c-96da-fcde13534558-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-0a7c856d-7c7d-435c-96da-fcde13534558-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-quobyte-0a7c856d-7c7d-435c-96da-fcde13534558" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-0a7c856d-7c7d-435c-96da-fcde13534558" acquired by "delete_volume" :: waited 0.037s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[729d1aa3-0d47-4c5f-b6b7-1eb8f1530379]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:54 devstack sudo[94977]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.270s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c9f9ac3b-3f4e-45a3-86af-b6c8d3ad2703 tempest-GroupsTest-138479430 None] Delete group completed successfully. Jul 07 18:06:54 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.110s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Deleted volume successfully. Jul 07 18:06:54 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558 Jul 07 18:06:54 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05314202-066e-4aab-8b2d-f9e48454b1a2 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-cb1a2f47-1a75-4cce-aa4b-226af0d038b9-delete_volume" released by "delete_volume" :: held 3.981s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-18159a2f-eb98-4161-b9bc-16dec9b10aab tempest-GroupsTest-138479430 None] Group tempest-GroupsTest-Group-188962142: creating Jul 07 18:06:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-18159a2f-eb98-4161-b9bc-16dec9b10aab tempest-GroupsTest-138479430 None] Group tempest-GroupsTest-Group-188962142: created successfully Jul 07 18:06:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-18159a2f-eb98-4161-b9bc-16dec9b10aab tempest-GroupsTest-138479430 None] Create group completed successfully. Jul 07 18:06:55 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558" returned: 0 in 1.095s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:55 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558 Jul 07 18:06:55 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:56 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0a7c856d-7c7d-435c-96da-fcde13534558" returned: 0 in 0.760s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-0a7c856d-7c7d-435c-96da-fcde13534558" released by "delete_volume" :: held 1.940s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created reservations ['899326d4-b4d4-43b7-8c07-fecfe25dcbf7', 'a5387ee2-37a8-4e63-9a9a-3a49a52b76bb', '38098bd1-eab2-4840-b8c3-9116634b2be2', '5a55377c-e7db-4d35-aed2-ffe6b2d74006'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:56 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:56 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-0511d432-d66c-4f7f-b3d3-b7848e5fabbd-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-0511d432-d66c-4f7f-b3d3-b7848e5fabbd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-quobyte-0511d432-d66c-4f7f-b3d3-b7848e5fabbd" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-0511d432-d66c-4f7f-b3d3-b7848e5fabbd" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c16031-437b-4606-a900-2ac896ad189c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:06:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Flow 'volume_create_manager' (2b75d515-8b92-4017-81d7-e10891f6c469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:56 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd Jul 07 18:06:56 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc73b7c1-e553-4439-85a4-0065724b1f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc73b7c1-e553-4439-85a4-0065724b1f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872064243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23eed8dd-920a-47b5-bde0-d33f59ca490a,host='devstack@QuobyteHD#QuobyteHD',id=01631e2e-7ae0-44ca-9f60-2fe0bea7252a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237a2f181141461db53d113ad4d4e714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:57Z,use_quota=True,user_id='9ff16c7005fc4f749373febe72964d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec8674cb-2e47-486d-8aa7-3478089db079),volume_type_id=ec8674cb-2e47-486d-8aa7-3478089db079)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800eb1b6-3616-4494-a2a3-d03172ce0bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800eb1b6-3616-4494-a2a3-d03172ce0bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ee12a1-c9c3-4972-8f42-fe4fee3f018d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ee12a1-c9c3-4972-8f42-fe4fee3f018d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01631e2e-7ae0-44ca-9f60-2fe0bea7252a', 'volume_name': 'volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd5eb48-7f94-4a25-95f6-0d77ad695f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd5eb48-7f94-4a25-95f6-0d77ad695f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8621d16d-771c-49e8-9982-2b53602a240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Volume 01631e2e-7ae0-44ca-9f60-2fe0bea7252a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a', 'volume_size': 1} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23eed8dd-920a-47b5-bde0-d33f59ca490a,created_at=2026-07-07T16:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1872064243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23eed8dd-920a-47b5-bde0-d33f59ca490a,host='devstack@QuobyteHD#QuobyteHD',id=01631e2e-7ae0-44ca-9f60-2fe0bea7252a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237a2f181141461db53d113ad4d4e714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:06:57Z,use_quota=True,user_id='9ff16c7005fc4f749373febe72964d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec8674cb-2e47-486d-8aa7-3478089db079),volume_type_id=ec8674cb-2e47-486d-8aa7-3478089db079)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Creating volume 01631e2e-7ae0-44ca-9f60-2fe0bea7252a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:06:57 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:57 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a 1073741824 Jul 07 18:06:57 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:57 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.920s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Deleted volume successfully. Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73373bb0-da09-46da-b3ec-0dcf70b2cafd tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-0a7c856d-7c7d-435c-96da-fcde13534558-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:57 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd" returned: 0 in 1.057s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:57 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd Jul 07 18:06:57 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:58 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a 1073741824" returned: 0 in 1.228s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:58 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a Jul 07 18:06:58 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:58 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0511d432-d66c-4f7f-b3d3-b7848e5fabbd" returned: 0 in 0.901s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-0511d432-d66c-4f7f-b3d3-b7848e5fabbd" released by "delete_volume" :: held 2.039s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:06:58 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created reservations ['12539cc1-344d-4ea2-bbdc-12a234d5fd18', 'c691c13b-1855-49b9-9858-8808611bc841', '1842ed46-182b-4a7b-928a-aabc52e48165', '21884c4a-1e71-4bac-a11b-3328284dce58'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:06:59 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:06:59 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:06:59 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a" returned: 0 in 0.897s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8621d16d-771c-49e8-9982-2b53602a240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7982e17-e564-4be8-8e96-43c17b2269a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:06:59 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Volume volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a (01631e2e-7ae0-44ca-9f60-2fe0bea7252a): created successfully Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7982e17-e564-4be8-8e96-43c17b2269a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Flow 'volume_create_manager' (2b75d515-8b92-4017-81d7-e10891f6c469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:06:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2a073bcf-9dc1-4e19-b30c-927bf12c573f tempest-GroupsTest-138479430 None] Created volume successfully. Jul 07 18:06:59 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.917s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:06:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Deleted volume successfully. Jul 07 18:06:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d26d06e4-6751-43b6-b976-64eebb24986f tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-0511d432-d66c-4f7f-b3d3-b7848e5fabbd-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-ae74316d-1146-4a3d-a857-1a722f6c7b32-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-ae74316d-1146-4a3d-a857-1a722f6c7b32-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "cinder-quobyte-ae74316d-1146-4a3d-a857-1a722f6c7b32" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-ae74316d-1146-4a3d-a857-1a722f6c7b32" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:00 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6df5d4-e882-40fc-9416-5f5e4f5c25b2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:00 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 Jul 07 18:07:00 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:01 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32" returned: 0 in 1.278s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:01 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32 Jul 07 18:07:01 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Flow 'volume_create_manager' (2146c4e5-cd5c-4868-9126-1d158eaf2b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5590de3-1a1e-42a3-a808-cb55c3c221f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5590de3-1a1e-42a3-a808-cb55c3c221f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2141922802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23eed8dd-920a-47b5-bde0-d33f59ca490a,host='devstack@QuobyteHD#QuobyteHD',id=b99bf64b-5149-4f36-aff3-af1b5e2b649f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237a2f181141461db53d113ad4d4e714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:02Z,use_quota=True,user_id='9ff16c7005fc4f749373febe72964d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec8674cb-2e47-486d-8aa7-3478089db079),volume_type_id=ec8674cb-2e47-486d-8aa7-3478089db079)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240aae46-c778-44f8-9b15-0aee27dd52de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240aae46-c778-44f8-9b15-0aee27dd52de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38de3712-33e3-4215-a407-bf3b176591c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38de3712-33e3-4215-a407-bf3b176591c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b99bf64b-5149-4f36-aff3-af1b5e2b649f', 'volume_name': 'volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb901f0-6714-4ec3-9db2-c8fd4baed15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb901f0-6714-4ec3-9db2-c8fd4baed15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0507af58-8ae0-4b3a-8ca8-d1790eea582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:01 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Volume b99bf64b-5149-4f36-aff3-af1b5e2b649f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f', 'volume_size': 1} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=23eed8dd-920a-47b5-bde0-d33f59ca490a,created_at=2026-07-07T16:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2141922802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=23eed8dd-920a-47b5-bde0-d33f59ca490a,host='devstack@QuobyteHD#QuobyteHD',id=b99bf64b-5149-4f36-aff3-af1b5e2b649f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237a2f181141461db53d113ad4d4e714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:02Z,use_quota=True,user_id='9ff16c7005fc4f749373febe72964d26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec8674cb-2e47-486d-8aa7-3478089db079),volume_type_id=ec8674cb-2e47-486d-8aa7-3478089db079)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Creating volume b99bf64b-5149-4f36-aff3-af1b5e2b649f {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:01 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:07:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:01 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f 1073741824 Jul 07 18:07:01 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:02 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ae74316d-1146-4a3d-a857-1a722f6c7b32" returned: 0 in 0.859s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-quobyte-ae74316d-1146-4a3d-a857-1a722f6c7b32" released by "delete_volume" :: held 2.188s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=171,cinder:SELECT=138,cinder:INSERT=44,cinder:DELETE=11 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Created reservations ['3bda6039-0e92-4d76-a232-9722ea6242cb', '267c408e-3350-4713-ab90-250c22cf7e7f', '9f75dfbd-fac7-44de-9ed1-af78adccd72a', '5714e792-eb4d-4de7-8f28-9e83eea0be66'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:02 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:07:02 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:02 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f 1073741824" returned: 0 in 1.151s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:03 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f Jul 07 18:07:03 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:03 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.761s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:07:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Deleted volume successfully. Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e6cd4e3-85f6-4e70-bdfa-5e9973b84456 tempest-CreateVolumesFromSourceVolumeTest-1700079365 None] Lock "cinder-ae74316d-1146-4a3d-a857-1a722f6c7b32-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:03 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f" returned: 0 in 0.855s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0507af58-8ae0-4b3a-8ca8-d1790eea582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21d6748-c115-4fb8-a447-dd64e278d528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:03 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Volume volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f (b99bf64b-5149-4f36-aff3-af1b5e2b649f): created successfully Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21d6748-c115-4fb8-a447-dd64e278d528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Flow 'volume_create_manager' (2146c4e5-cd5c-4868-9126-1d158eaf2b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f7dc415d-42f9-4df0-b98c-c8988825eacb tempest-GroupsTest-138479430 None] Created volume successfully. Jul 07 18:07:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-48f1fd65-fe8e-44d8-af1b-4d5399edaa4e tempest-GroupsTest-138479430 None] Update group completed successfully. Jul 07 18:07:05 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d6c20b00-19dc-4b4b-bda7-faa899ae9d83 tempest-GroupsTest-138479430 None] Update group completed successfully. Jul 07 18:07:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Acquiring lock "cinder-quobyte-01631e2e-7ae0-44ca-9f60-2fe0bea7252a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Lock "cinder-quobyte-01631e2e-7ae0-44ca-9f60-2fe0bea7252a" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf659f-e6b5-46fd-a700-19d11435a45d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:08 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a Jul 07 18:07:08 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:09 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a" returned: 0 in 1.108s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:09 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a Jul 07 18:07:09 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:10 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-01631e2e-7ae0-44ca-9f60-2fe0bea7252a" returned: 0 in 1.049s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Lock "cinder-quobyte-01631e2e-7ae0-44ca-9f60-2fe0bea7252a" released by "delete_volume" :: held 2.240s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Acquiring lock "cinder-quobyte-b99bf64b-5149-4f36-aff3-af1b5e2b649f" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Lock "cinder-quobyte-b99bf64b-5149-4f36-aff3-af1b5e2b649f" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:10 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[16130f2b-e940-46fb-b811-b88b88c1c229]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:10 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f Jul 07 18:07:10 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:11 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f" returned: 0 in 1.131s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:11 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f Jul 07 18:07:11 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:12 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b99bf64b-5149-4f36-aff3-af1b5e2b649f" returned: 0 in 0.952s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Lock "cinder-quobyte-b99bf64b-5149-4f36-aff3-af1b5e2b649f" released by "delete_volume" :: held 2.137s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Created reservations ['d6dfcba2-d96f-4a3d-9aba-19461aca02d8'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:07:12 devstack cinder-volume[86972]: WARNING cinder.quota [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1861274681 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1861274681, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:07:12 devstack cinder-volume[86972]: WARNING cinder.quota [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1861274681 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1861274681, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Created reservations ['67d71e6a-605b-4ff9-b929-9e7cce555f5a', 'dc561b7f-4b9d-43cf-b2bd-d76b49dc44dd', '561d9614-5ed3-40e1-aaa4-0201a8d809fa', '9e67b6e2-c89b-4c92-acf2-3f7c4194974f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Created reservations ['f95a1317-c352-40fa-9cca-6e248b6b0b5c', 'f0fad5f5-f52b-4c8f-be90-8512faf6ff50', '9d192c40-1b69-4ef5-8d55-d37b040f1d37', '0aafee83-c12b-4472-b9bf-ea692cd1300c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:12 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:07:12 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:12 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:07:12 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:14 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.199s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:14 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:07:14 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:07:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:07:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:07:14 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.299s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:14 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:07:14 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-49e5460d-fac2-4954-a228-4bd34fa035bd tempest-GroupsTest-138479430 None] Delete group completed successfully. Jul 07 18:07:21 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b0442b8c-7d21-4389-9711-5081b563b557 tempest-GroupsV320Test-316651088 None] Group tempest-GroupsV320Test-Group-1136920074: creating Jul 07 18:07:21 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b0442b8c-7d21-4389-9711-5081b563b557 tempest-GroupsV320Test-316651088 None] Group tempest-GroupsV320Test-Group-1136920074: created successfully Jul 07 18:07:21 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b0442b8c-7d21-4389-9711-5081b563b557 tempest-GroupsV320Test-316651088 None] Create group completed successfully. Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Flow 'volume_create_manager' (8d0d5970-6dad-4feb-aa78-b4b8ab4a0c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2096b98e-f112-43cb-b282-db258d91b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2096b98e-f112-43cb-b282-db258d91b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1357583542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca14713ad54542dc913b5bb28414d29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:23Z,use_quota=True,user_id='0fd0581d4eea4883934628f39f0cefee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71982b4-7ade-4879-9941-d39b936faff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71982b4-7ade-4879-9941-d39b936faff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38420c23-519c-42d4-8396-cd1d1529f840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38420c23-519c-42d4-8396-cd1d1529f840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f1d8f7-bb9b-437b-aedf-3fa92d0ca103', 'volume_name': 'volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324865dd-ef2f-4633-8cd7-3849a028d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324865dd-ef2f-4633-8cd7-3849a028d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65ac08a-1e54-417f-bd54-e1ae112816a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:22 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Volume d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103', 'volume_size': 1} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1357583542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca14713ad54542dc913b5bb28414d29f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:23Z,use_quota=True,user_id='0fd0581d4eea4883934628f39f0cefee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Creating volume d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:22 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:07:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:22 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 1073741824 Jul 07 18:07:22 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] Created reservations ['9208677a-f5ce-44f7-9f33-fe0221fc59f3'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:23 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:07:23 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:23 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 1073741824" returned: 0 in 0.968s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:23 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 Jul 07 18:07:23 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:23 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.661s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:23 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:07:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3fa1e07c-0bc2-4f22-95ab-9c898e3c1cb2 tempest-GroupsV320Test-316651088 None] Delete group completed successfully. Jul 07 18:07:24 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" returned: 0 in 0.649s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65ac08a-1e54-417f-bd54-e1ae112816a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a459f3a2-5a0a-4e3c-ac43-f0f4e2c34ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:24 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Volume volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 (d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103): created successfully Jul 07 18:07:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a459f3a2-5a0a-4e3c-ac43-f0f4e2c34ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Flow 'volume_create_manager' (8d0d5970-6dad-4feb-aa78-b4b8ab4a0c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d0f5e763-a17b-49bf-a714-eeda46132f72 tempest-VolumesActionsTest-1378495400 None] Created volume successfully. Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Flow 'volume_create_manager' (ed13ebb3-a865-4cf3-92ef-6a0801f51bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e772eee-28b5-4172-96d4-bff22baaaeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e772eee-28b5-4172-96d4-bff22baaaeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1389547516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e6c06d-db2d-4b45-afb0-0aa1bf483edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6377ee17a6f4940b897c1f595baeeb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:31Z,use_quota=True,user_id='b29d994299e14df7ae6a214ad007834c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5c9da0-1a98-44c7-a512-7e761ec5d6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f5c9da0-1a98-44c7-a512-7e761ec5d6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd0ca61-ac83-4b65-a6b3-89055c83b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd0ca61-ac83-4b65-a6b3-89055c83b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e6c06d-db2d-4b45-afb0-0aa1bf483edc', 'volume_name': 'volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0129e57b-e997-4047-8fb5-b1441c58a354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0129e57b-e997-4047-8fb5-b1441c58a354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ccdf97-4703-41a6-afc1-8ebe1d16cb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:30 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc', 'volume_size': 1} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1389547516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e6c06d-db2d-4b45-afb0-0aa1bf483edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6377ee17a6f4940b897c1f595baeeb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:31Z,use_quota=True,user_id='b29d994299e14df7ae6a214ad007834c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Creating volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:30 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:07:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:30 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc 1073741824 Jul 07 18:07:30 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:32 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc 1073741824" returned: 0 in 1.204s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:32 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc Jul 07 18:07:32 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:32 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" returned: 0 in 0.818s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ccdf97-4703-41a6-afc1-8ebe1d16cb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d17075-4307-40f4-a3d7-7677842e343b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:32 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Volume volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc (74e6c06d-db2d-4b45-afb0-0aa1bf483edc): created successfully Jul 07 18:07:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d17075-4307-40f4-a3d7-7677842e343b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Flow 'volume_create_manager' (ed13ebb3-a865-4cf3-92ef-6a0801f51bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1f7d342b-7b4e-4b07-af2f-89c72f0b53f4 tempest-SnapshotsActionsTest-804007744 None] Created volume successfully. Jul 07 18:07:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Creating offline snapshot 57b5495e-1ea2-4226-9dff-9f7f11efe303 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:07:34 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee3cc8a-05bd-4925-a001-5cba7a85962d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:34 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc Jul 07 18:07:34 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:35 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" returned: 0 in 1.044s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:35 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 1G Jul 07 18:07:35 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:36 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 1G" returned: 0 in 1.139s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:36 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:07:36 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:37 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.982s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:37 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 is being set with open permissions: ugo+rw Jul 07 18:07:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:37 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:07:37 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:38 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 1.268s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:38 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.info Jul 07 18:07:38 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:39 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.info" returned: 0 in 0.772s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:39 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.info is being set with open permissions: ugo+rw Jul 07 18:07:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:39 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.info Jul 07 18:07:39 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:40 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.info" returned: 0 in 0.703s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.028s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0dc2bf49-8fb2-4ce7-b6ce-0934b6142b9a tempest-SnapshotsActionsTest-804007744 None] Create snapshot completed successfully Jul 07 18:07:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Creating offline snapshot 95dad05a-7ddd-4b3f-8799-3fafb94f97b0 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:07:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[378f2a0c-d921-4645-b460-9e011470bd84]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:41 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:07:41 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1e735813-7e01-45b2-aaeb-95f6b864571e tempest-VolumesActionsTest-1378495400 None] Acquiring lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" by "attach_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1e735813-7e01-45b2-aaeb-95f6b864571e tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" acquired by "attach_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:42 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.972s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:07:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1e735813-7e01-45b2-aaeb-95f6b864571e tempest-VolumesActionsTest-1378495400 None] Attaching volume d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 to instance 3d842798-7875-442c-b858-9aa1feee10af at mountpoint /dev/vdb on host None. Jul 07 18:07:42 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 1G Jul 07 18:07:42 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1e735813-7e01-45b2-aaeb-95f6b864571e tempest-VolumesActionsTest-1378495400 None] Attach volume completed successfully. Jul 07 18:07:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1e735813-7e01-45b2-aaeb-95f6b864571e tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" released by "attach_volume" :: held 0.193s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4adb2cd8-dea7-437a-8877-5d5165664420 tempest-VolumesActionsTest-1378495400 None] Acquiring lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103-detach_volume" by "detach_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4adb2cd8-dea7-437a-8877-5d5165664420 tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4adb2cd8-dea7-437a-8877-5d5165664420 tempest-VolumesActionsTest-1378495400 None] Detaching volume d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 from instance 3d842798-7875-442c-b858-9aa1feee10af. Jul 07 18:07:43 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4adb2cd8-dea7-437a-8877-5d5165664420 tempest-VolumesActionsTest-1378495400 None] Detach volume completed successfully. Jul 07 18:07:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4adb2cd8-dea7-437a-8877-5d5165664420 tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:43 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 1G" returned: 0 in 0.988s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:43 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 Jul 07 18:07:43 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:44 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0" returned: 0 in 0.842s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:44 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 is being set with open permissions: ugo+rw Jul 07 18:07:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:44 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 Jul 07 18:07:44 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:44 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0" returned: 0 in 0.720s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.650s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:45 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5542877b-949e-4344-80cf-18abaaab0f80 tempest-SnapshotsActionsTest-804007744 None] Create snapshot completed successfully Jul 07 18:07:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-95dad05a-7ddd-4b3f-8799-3fafb94f97b0-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-95dad05a-7ddd-4b3f-8799-3fafb94f97b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-quobyte-95dad05a-7ddd-4b3f-8799-3fafb94f97b0" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-95dad05a-7ddd-4b3f-8799-3fafb94f97b0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Deleting offline snapshot 95dad05a-7ddd-4b3f-8799-3fafb94f97b0 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:07:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] snapshot_file for this snap is: volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:07:46 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[98301ae9-cc3d-4157-a306-e280293bf4df]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:46 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 Jul 07 18:07:46 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:46 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0" returned: 0 in 0.896s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:07:47 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc7ccac-6039-4d17-9fb7-1f0f3bf942d0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:47 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:07:47 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:47 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.786s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:07:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:47 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 Jul 07 18:07:47 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:48 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0" returned: 0 in 0.763s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:48 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0 Jul 07 18:07:48 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:49 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.95dad05a-7ddd-4b3f-8799-3fafb94f97b0" returned: 0 in 0.644s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-95dad05a-7ddd-4b3f-8799-3fafb94f97b0" released by "_delete_snapshot" :: held 3.192s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" released by "delete_snapshot" :: held 3.226s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:49 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=115,cinder:SELECT=97,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:07:49 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Created reservations ['b4b6d453-4ab3-4063-a3f5-6b0405336d84', '9dcec864-1838-4827-9474-7c181cbecc2e', 'df3a4e87-3152-4da2-895c-84c3aa8fcc3f', '89506574-855a-4a0e-a14b-b5b37758e5e9'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:07:49 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Delete snapshot completed successfully. Jul 07 18:07:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f254bed0-4c97-4043-ba07-07329025deab tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-95dad05a-7ddd-4b3f-8799-3fafb94f97b0-delete_snapshot" released by "delete_snapshot" :: held 3.379s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Creating offline snapshot 3e9e164a-d229-49c6-afb3-cbb044406721 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:07:50 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[adac5e2f-a952-4620-8f98-1c36ecabb9aa]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:50 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:07:50 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:51 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.784s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:07:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:51 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 1G Jul 07 18:07:51 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:52 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 1G" returned: 0 in 1.004s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:52 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 Jul 07 18:07:52 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:53 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721" returned: 0 in 0.796s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:53 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 is being set with open permissions: ugo+rw Jul 07 18:07:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:53 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 Jul 07 18:07:53 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:53 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721" returned: 0 in 0.727s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.418s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0ca1ad94-3ad6-4c0f-80b3-fd7ebe5792f1 tempest-SnapshotsActionsTest-804007744 None] Create snapshot completed successfully Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-3e9e164a-d229-49c6-afb3-cbb044406721-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-3e9e164a-d229-49c6-afb3-cbb044406721-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-quobyte-3e9e164a-d229-49c6-afb3-cbb044406721" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-3e9e164a-d229-49c6-afb3-cbb044406721" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Deleting offline snapshot 3e9e164a-d229-49c6-afb3-cbb044406721 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] snapshot_file for this snap is: volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a7cb16-cdd5-48ad-8cae-523c8a29df97]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:54 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 Jul 07 18:07:54 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:55 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721" returned: 0 in 0.790s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:07:55 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab5de66-64c2-493b-8d06-4ff657dfb4e9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:55 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:07:55 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:56 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.847s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:07:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:56 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 Jul 07 18:07:56 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Flow 'volume_create_manager' (df75e0b1-b9f8-4d08-a950-6cd59e4bcfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ca9a25-b992-4781-9a8f-40be81baef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ca9a25-b992-4781-9a8f-40be81baef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-156399721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930b2821-a99b-42af-8dbb-83d3ad9a099b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e524d0fe480c4bc8b7f2af7361195d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:57Z,use_quota=True,user_id='f9ed9f7ea3bd414ebc3feccae1165964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288a897d-00d3-483f-8a1d-7edc5dda82f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288a897d-00d3-483f-8a1d-7edc5dda82f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30246d02-aa5c-4b8c-8580-94ea5c7f0290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30246d02-aa5c-4b8c-8580-94ea5c7f0290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930b2821-a99b-42af-8dbb-83d3ad9a099b', 'volume_name': 'volume-930b2821-a99b-42af-8dbb-83d3ad9a099b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875e3036-a864-4b00-a843-48d2d849c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875e3036-a864-4b00-a843-48d2d849c410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bdabfb-5757-425f-83be-07a2d31fdb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Volume 930b2821-a99b-42af-8dbb-83d3ad9a099b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930b2821-a99b-42af-8dbb-83d3ad9a099b', 'volume_size': 1} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-156399721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930b2821-a99b-42af-8dbb-83d3ad9a099b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e524d0fe480c4bc8b7f2af7361195d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:07:57Z,use_quota=True,user_id='f9ed9f7ea3bd414ebc3feccae1165964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Creating volume 930b2821-a99b-42af-8dbb-83d3ad9a099b {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:07:57 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:57 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b 1073741824 Jul 07 18:07:57 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:57 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721" returned: 0 in 1.135s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:57 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721 Jul 07 18:07:57 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:58 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.3e9e164a-d229-49c6-afb3-cbb044406721" returned: 0 in 0.860s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:58 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b 1073741824" returned: 0 in 1.276s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-3e9e164a-d229-49c6-afb3-cbb044406721" released by "_delete_snapshot" :: held 3.729s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" released by "delete_snapshot" :: held 3.759s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:58 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b Jul 07 18:07:58 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:07:58 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Created reservations ['c563012e-23d6-47aa-aca8-f32690991c2a', 'fb8a3e31-c49b-42da-a77c-4628545e5f54', '06a250cf-184d-4264-82b6-42d8feada74d', '26fba148-30aa-4576-bfcf-f44ff59ec7a6'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:07:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Delete snapshot completed successfully. Jul 07 18:07:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-81355726-3865-4573-a827-809891ae859e tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-3e9e164a-d229-49c6-afb3-cbb044406721-delete_snapshot" released by "delete_snapshot" :: held 3.960s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:07:59 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b" returned: 0 in 0.942s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.308s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.027s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bdabfb-5757-425f-83be-07a2d31fdb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930b2821-a99b-42af-8dbb-83d3ad9a099b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1906ae6-c0fe-4195-abbf-d93624c74e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Creating offline snapshot 202cbaf5-d4a4-485d-b503-0143aa7db0b3 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:07:59 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Volume volume-930b2821-a99b-42af-8dbb-83d3ad9a099b (930b2821-a99b-42af-8dbb-83d3ad9a099b): created successfully Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1906ae6-c0fe-4195-abbf-d93624c74e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Flow 'volume_create_manager' (df75e0b1-b9f8-4d08-a950-6cd59e4bcfe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d359328-a5f9-4ae7-a1ee-250f6e647daf]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:07:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:07:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-75a8fd05-684f-4b8b-816a-9fed9d9fd696 tempest-AttachVolumeShelveTestJSON-407607550 None] Created volume successfully. Jul 07 18:07:59 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:07:59 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:00 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.800s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:08:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:00 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 1G Jul 07 18:08:00 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:01 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 1G" returned: 0 in 1.049s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:01 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 Jul 07 18:08:01 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:02 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3" returned: 0 in 0.820s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:02 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 is being set with open permissions: ugo+rw Jul 07 18:08:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:02 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 Jul 07 18:08:02 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:03 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3" returned: 0 in 0.857s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:INSERT=17,cinder:UPDATE=63,cinder:SELECT=55,cinder:DELETE=3 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.713s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-58794925-3911-408c-800e-d0d606c15374 tempest-SnapshotsActionsTest-804007744 None] Create snapshot completed successfully Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-202cbaf5-d4a4-485d-b503-0143aa7db0b3-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-202cbaf5-d4a4-485d-b503-0143aa7db0b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-quobyte-202cbaf5-d4a4-485d-b503-0143aa7db0b3" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-202cbaf5-d4a4-485d-b503-0143aa7db0b3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Deleting offline snapshot 202cbaf5-d4a4-485d-b503-0143aa7db0b3 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] snapshot_file for this snap is: volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[94333e33-6573-40f0-8e21-21c803e50857]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:04 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 Jul 07 18:08:04 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:04 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3" returned: 0 in 0.814s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:08:04 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[532e6f63-df18-4595-ba54-55a4d70d1584]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:04 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:08:04 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:05 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.920s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:08:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:05 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 Jul 07 18:08:05 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:06 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3" returned: 0 in 1.112s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:06 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3 Jul 07 18:08:06 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:07 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.202cbaf5-d4a4-485d-b503-0143aa7db0b3" returned: 0 in 1.000s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-afb550fd-9788-4c43-ad59-faaeecfed3d4 tempest-VolumesActionsTest-1378495400 None] Acquiring lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" by "attach_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-202cbaf5-d4a4-485d-b503-0143aa7db0b3" released by "_delete_snapshot" :: held 4.000s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" released by "delete_snapshot" :: held 4.029s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-afb550fd-9788-4c43-ad59-faaeecfed3d4 tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" acquired by "attach_volume" :: waited 0.035s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-afb550fd-9788-4c43-ad59-faaeecfed3d4 tempest-VolumesActionsTest-1378495400 None] Attaching volume d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 to instance 10c54dfc-2c83-4f96-b567-e2bc57fc8cd5 at mountpoint /dev/vdb on host None. Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Created reservations ['c1e93254-0480-461f-a785-5d003d604dd3', '3eefd4fc-f7ae-4bc8-911a-89a5a78f5f0e', 'a6600166-51f7-4489-8a9f-a00a314a9deb', '0781b498-cd45-4aff-983c-637f0046abd9'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-afb550fd-9788-4c43-ad59-faaeecfed3d4 tempest-VolumesActionsTest-1378495400 None] Attach volume completed successfully. Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-afb550fd-9788-4c43-ad59-faaeecfed3d4 tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" released by "attach_volume" :: held 0.131s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Delete snapshot completed successfully. Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1ed6c9d0-3ac4-4ad2-951b-d5a18a74561a tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-202cbaf5-d4a4-485d-b503-0143aa7db0b3-delete_snapshot" released by "delete_snapshot" :: held 4.265s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Creating offline snapshot 409a2007-1695-4709-bfe2-ddf6db4ec2f9 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-471688cc-d60c-49eb-b7c3-b93576d3d396 tempest-VolumesActionsTest-1378495400 None] Acquiring lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103-detach_volume" by "detach_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9b5f89-ae26-4b8c-abb9-41113b499697]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-471688cc-d60c-49eb-b7c3-b93576d3d396 tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-471688cc-d60c-49eb-b7c3-b93576d3d396 tempest-VolumesActionsTest-1378495400 None] Detaching volume d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 from instance 10c54dfc-2c83-4f96-b567-e2bc57fc8cd5. Jul 07 18:08:08 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:08:08 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-471688cc-d60c-49eb-b7c3-b93576d3d396 tempest-VolumesActionsTest-1378495400 None] Detach volume completed successfully. Jul 07 18:08:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-471688cc-d60c-49eb-b7c3-b93576d3d396 tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103-detach_volume" released by "detach_volume" :: held 0.242s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:10 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 1.290s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:08:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:10 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 1G Jul 07 18:08:10 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:10 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 1G" returned: 0 in 0.914s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:10 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 Jul 07 18:08:10 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:11 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9" returned: 0 in 0.877s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:11 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 is being set with open permissions: ugo+rw Jul 07 18:08:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:11 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 Jul 07 18:08:11 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:12 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9" returned: 0 in 0.793s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.019s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:12 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6395b104-1150-4862-a53b-2b691e487d74 tempest-SnapshotsActionsTest-804007744 None] Create snapshot completed successfully Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:12 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:08:12 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-409a2007-1695-4709-bfe2-ddf6db4ec2f9-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-409a2007-1695-4709-bfe2-ddf6db4ec2f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Acquiring lock "cinder-quobyte-409a2007-1695-4709-bfe2-ddf6db4ec2f9" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-409a2007-1695-4709-bfe2-ddf6db4ec2f9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Deleting offline snapshot 409a2007-1695-4709-bfe2-ddf6db4ec2f9 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] snapshot_file for this snap is: volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87770ce-d6ba-4b49-ae5f-5a89d0ac689f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:13 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 Jul 07 18:08:13 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:13 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.738s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:08:13 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9" returned: 0 in 0.909s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffcbccd-51f4-4715-b92c-9bce9f479bfe]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:14 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:08:14 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:14 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.954s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:08:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:14 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 Jul 07 18:08:14 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:15 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:15 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9 Jul 07 18:08:15 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-a2d3c2d9-64e2-4d68-9927-9aa2af935ed8 req-299b00ac-f5e0-439e-b998-088b51591d09 tempest-AttachVolumeShelveTestJSON-407607550 None] No connector for attachment 19d91de0-af4c-4860-b6f3-f3dbed44489a; skipping storage backend terminate_connection call. {{(pid=86972) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 07 18:08:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-a2d3c2d9-64e2-4d68-9927-9aa2af935ed8 req-299b00ac-f5e0-439e-b998-088b51591d09 tempest-AttachVolumeShelveTestJSON-407607550 None] Deleting attachment 19d91de0-af4c-4860-b6f3-f3dbed44489a. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:08:16 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.409a2007-1695-4709-bfe2-ddf6db4ec2f9" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-409a2007-1695-4709-bfe2-ddf6db4ec2f9" released by "_delete_snapshot" :: held 3.536s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" released by "delete_snapshot" :: held 3.566s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:16 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Created reservations ['d1b1a260-49f6-4c9b-b68d-5c79ee336318', '5f7d83f6-d079-44b3-b2d9-360d67429f87', 'da2d2909-00a5-4f0d-8242-f6538aef8018', 'd3019305-1307-42e6-9202-92b811d25b24'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:16 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Delete snapshot completed successfully. Jul 07 18:08:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46212efa-9ee0-4b77-93a3-4e3760334ae7 tempest-SnapshotsActionsTest-1231943313 None] Lock "cinder-409a2007-1695-4709-bfe2-ddf6db4ec2f9-delete_snapshot" released by "delete_snapshot" :: held 3.713s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "cinder-57b5495e-1ea2-4226-9dff-9f7f11efe303-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-57b5495e-1ea2-4226-9dff-9f7f11efe303-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "cinder-quobyte-57b5495e-1ea2-4226-9dff-9f7f11efe303" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-quobyte-57b5495e-1ea2-4226-9dff-9f7f11efe303" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Deleting offline snapshot 57b5495e-1ea2-4226-9dff-9f7f11efe303 of volume 74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] snapshot_file for this snap is: volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1479482-1ca0-4e32-8b4a-42eb438bf1ab]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:17 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:08:17 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:18 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.893s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:08:18 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a05e0ba-3715-4c07-b62c-32002aa3bbce]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:18 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc Jul 07 18:08:18 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd2485c-7698-4177-95d9-6b4f8714e4fa]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:19 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 Jul 07 18:08:19 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:19 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" returned: 0 in 0.899s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:19 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:08:19 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:20 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" returned: 0 in 0.855s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:20 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f753eb4-16c5-4094-84e2-d07c9a2ecd2f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:20 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 Jul 07 18:08:20 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:20 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.820s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:20 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303 Jul 07 18:08:20 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:20 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" returned: 0 in 0.895s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.18e1cda2-c39d-40d3-985c-7d9064ca178cq2tu34b5.img {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:20 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.18e1cda2-c39d-40d3-985c-7d9064ca178cq2tu34b5.img Jul 07 18:08:20 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:21 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc.57b5495e-1ea2-4226-9dff-9f7f11efe303" returned: 0 in 0.631s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-quobyte-57b5495e-1ea2-4226-9dff-9f7f11efe303" released by "_delete_snapshot" :: held 3.384s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" released by "delete_snapshot" :: held 3.409s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:21 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Created reservations ['b13d3e1e-5c0e-4979-b4ff-58d34498687b', '19924c25-8db5-4916-bb88-420b0ef00010', '615ac26b-d6f0-435f-82ee-7ed26e68279c', '43639e44-1dd3-405c-8291-bf71422a8669'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:21 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Delete snapshot completed successfully. Jul 07 18:08:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6eed4a09-0bde-496a-a3e3-659e52f7e66e tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-57b5495e-1ea2-4226-9dff-9f7f11efe303-delete_snapshot" released by "delete_snapshot" :: held 3.589s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "cinder-74e6c06d-db2d-4b45-afb0-0aa1bf483edc-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-74e6c06d-db2d-4b45-afb0-0aa1bf483edc-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" acquired by "delete_volume" :: waited 0.037s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:22 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3ea789-7d61-49dc-b1f5-914a0acfbfcf]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:22 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc Jul 07 18:08:22 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:24 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" returned: 0 in 1.824s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:24 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc Jul 07 18:08:24 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:26 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" returned: 0 in 2.027s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-quobyte-74e6c06d-db2d-4b45-afb0-0aa1bf483edc" released by "delete_volume" :: held 3.977s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Created reservations ['632171b6-d939-4599-b5b2-5d7d373dc584', '255ee6df-2c93-4071-a2d5-9ff68407cfbe', '624e7564-312f-46ce-9e37-1f9851fa99e5', 'ee5b962b-78e1-4d53-91f9-8630f356956c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:26 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.18e1cda2-c39d-40d3-985c-7d9064ca178cq2tu34b5.img" returned: 0 in 5.658s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:26 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:08:26 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd2d562-6eda-4dee-a7c6-4b350a64641d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:26 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 Jul 07 18:08:26 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:27 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.743s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:27 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Deleted volume successfully. Jul 07 18:08:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8b40136c-cd55-4ae2-80a2-43d308dd5469 tempest-SnapshotsActionsTest-804007744 None] Lock "cinder-74e6c06d-db2d-4b45-afb0-0aa1bf483edc-delete_volume" released by "delete_volume" :: held 5.121s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:27 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" returned: 0 in 1.063s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:27 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.18e1cda2-c39d-40d3-985c-7d9064ca178cq2tu34b5.img {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:08:27 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Converted 1024.00 MB image at 180.94 MB/s Jul 07 18:08:27 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] 18e1cda2-c39d-40d3-985c-7d9064ca178c was raw, no need to convert to raw {{(pid=86972) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 18:08:37 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:INSERT=10,cinder:UPDATE=51,cinder:SELECT=45,cinder:DELETE=4 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:08:37 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:INSERT=11,cinder:SELECT=31,cinder:UPDATE=25 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Flow 'volume_create_manager' (6f092848-0f08-4e6f-9d08-99f3c864c618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58daa51f-696e-48e9-81b3-1ae66f0920f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58daa51f-696e-48e9-81b3-1ae66f0920f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1707842066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb7d00d-38e2-4bd0-ab80-56c057f8176a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73187a3ca294a449c83a3e2cd2b2de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:45Z,use_quota=True,user_id='6c9a5ba7f3504e31a879711f71f94ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d623f3-07c0-4ebd-aabc-006e0d5b65ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d623f3-07c0-4ebd-aabc-006e0d5b65ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac5f075-e7a4-4fba-aa99-0e66e21398e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac5f075-e7a4-4fba-aa99-0e66e21398e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3eb7d00d-38e2-4bd0-ab80-56c057f8176a', 'volume_name': 'volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ade473-7f21-4e54-b6df-d5264817b005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ade473-7f21-4e54-b6df-d5264817b005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2da7d7-3cd7-4867-b925-4a7e09d8e87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:45 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Volume 3eb7d00d-38e2-4bd0-ab80-56c057f8176a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a', 'volume_size': 1} Jul 07 18:08:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.344s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Uploaded volume to glance image-id: 18e1cda2-c39d-40d3-985c-7d9064ca178c. {{(pid=86972) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.168s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:08:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1707842066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb7d00d-38e2-4bd0-ab80-56c057f8176a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73187a3ca294a449c83a3e2cd2b2de0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:08:45Z,use_quota=True,user_id='6c9a5ba7f3504e31a879711f71f94ef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Creating volume 3eb7d00d-38e2-4bd0-ab80-56c057f8176a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:08:51 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:08:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c7d80c5b-f568-4498-a803-cebec7ed67a0 tempest-VolumesActionsTest-1378495400 None] Copy volume to image completed successfully. Jul 07 18:08:51 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a 1073741824 Jul 07 18:08:51 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:52 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a 1073741824" returned: 0 in 0.857s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:52 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a Jul 07 18:08:52 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:53 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a" returned: 0 in 0.705s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2da7d7-3cd7-4867-b925-4a7e09d8e87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae30d979-6bc3-44dc-a7f2-6db79d991062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:08:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Volume volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a (3eb7d00d-38e2-4bd0-ab80-56c057f8176a): created successfully Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae30d979-6bc3-44dc-a7f2-6db79d991062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Flow 'volume_create_manager' (6f092848-0f08-4e6f-9d08-99f3c864c618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:08:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-92f49df5-60f5-4d5d-9adb-12725dd37242 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Created volume successfully. Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa64156-dea5-453b-8b8d-d2118ad0b4c0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:53 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 Jul 07 18:08:53 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:54 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" returned: 0 in 0.790s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc2ccf3-b7bf-4ecf-8d08-3794664914e9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:54 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 Jul 07 18:08:54 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Acquiring lock "cinder-3eb7d00d-38e2-4bd0-ab80-56c057f8176a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "cinder-3eb7d00d-38e2-4bd0-ab80-56c057f8176a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Acquiring lock "cinder-quobyte-3eb7d00d-38e2-4bd0-ab80-56c057f8176a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "cinder-quobyte-3eb7d00d-38e2-4bd0-ab80-56c057f8176a" acquired by "delete_volume" :: waited 0.013s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab706d61-5296-4708-8bbb-1bca0e361ea7]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:54 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" returned: 0 in 0.818s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:55 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a Jul 07 18:08:55 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:55 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img Jul 07 18:08:55 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:55 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a" returned: 0 in 0.781s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:55 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a Jul 07 18:08:55 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:56 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3eb7d00d-38e2-4bd0-ab80-56c057f8176a" returned: 0 in 1.158s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "cinder-quobyte-3eb7d00d-38e2-4bd0-ab80-56c057f8176a" released by "delete_volume" :: held 1.998s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:08:56 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Created reservations ['8cd5bac8-2161-42d3-a900-67bfe926dfcb', 'c5614ebc-4f62-48ae-8de1-a79ee19ab68b', '00bb2741-7408-420e-8022-97db328c9dd6', 'dd954e30-df47-4689-89ed-024de8860cca'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:08:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:08:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:08:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:08:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:08:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:08:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:08:57 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:08:57 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:08:58 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jul 07 18:08:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.008s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:08:58 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:08:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Deleted volume successfully. Jul 07 18:08:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7601ff1e-c6e5-4d54-bdab-db5b3d3adef7 tempest-VolumeQuotasNegativeTestJSON-1716065674 None] Lock "cinder-3eb7d00d-38e2-4bd0-ab80-56c057f8176a-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:00 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img" returned: 0 in 5.570s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:00 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ae568f-043e-4eea-827c-10543b557b54]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:00 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 Jul 07 18:09:00 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:01 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" returned: 0 in 1.068s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:01 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:09:01 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Converted 1024.00 MB image at 183.82 MB/s Jul 07 18:09:01 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] e6177e84-70ab-4a30-84bf-981cbf915499 was raw, converting to qcow2 {{(pid=86972) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 18:09:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73e7e06-436d-493b-aa82-50f39b75dbad]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:01 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img Jul 07 18:09:01 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:02 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img" returned: 0 in 0.829s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:02 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img Jul 07 18:09:02 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:03 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img" returned: 1 in 0.795s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:09:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img /opt/stack/data/cinder/conversion/vol_upload_sg14loqm {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:03 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img /opt/stack/data/cinder/conversion/vol_upload_sg14loqm Jul 07 18:09:03 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:04 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img /opt/stack/data/cinder/conversion/vol_upload_sg14loqm" returned: 0 in 0.854s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:04 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Image conversion details: src /opt/stack/data/cinder/conversion/d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103.temp_image.e6177e84-70ab-4a30-84bf-981cbf9154999g0s8osk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_sg14loqm {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:09:04 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 18:09:04 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c054b-4081-45e0-b419-51c3027b12c2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sg14loqm {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:04 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sg14loqm Jul 07 18:09:04 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:05 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sg14loqm" returned: 0 in 0.949s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:05 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Flow 'volume_create_manager' (d944d526-fce6-4491-928d-4f3cbccec158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5983d4fc-63bb-4f7a-aebf-ad81d99d3b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5983d4fc-63bb-4f7a-aebf-ad81d99d3b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-475800973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de70f155-1f2f-45cb-bd6f-91ca019209e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552be50f90434235a5357d09b4e049c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:06Z,use_quota=True,user_id='1b32e52149844c3eb7a9b496ea483339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec91c90-ed4a-4eaa-b07f-3269e2109f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec91c90-ed4a-4eaa-b07f-3269e2109f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7b2ca3-17c4-4f06-83db-0c746e5fea9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7b2ca3-17c4-4f06-83db-0c746e5fea9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de70f155-1f2f-45cb-bd6f-91ca019209e9', 'volume_name': 'volume-de70f155-1f2f-45cb-bd6f-91ca019209e9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400fef19-87bf-467d-ac10-02285bee7921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (400fef19-87bf-467d-ac10-02285bee7921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e0cb10-21e5-4200-a34c-394c67f74880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Volume de70f155-1f2f-45cb-bd6f-91ca019209e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de70f155-1f2f-45cb-bd6f-91ca019209e9', 'volume_size': 1} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.245s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Uploaded volume to glance image-id: e6177e84-70ab-4a30-84bf-981cbf915499. {{(pid=86972) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-475800973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de70f155-1f2f-45cb-bd6f-91ca019209e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552be50f90434235a5357d09b4e049c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:06Z,use_quota=True,user_id='1b32e52149844c3eb7a9b496ea483339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Creating volume de70f155-1f2f-45cb-bd6f-91ca019209e9 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:06 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:06 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 1073741824 Jul 07 18:09:06 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a76046b3-072b-4221-8a2e-b263b0cddbc1 tempest-VolumesActionsTest-1378495400 None] Copy volume to image completed successfully. Jul 07 18:09:07 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 1073741824" returned: 0 in 0.859s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:07 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 Jul 07 18:09:07 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Acquiring lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Acquiring lock "cinder-quobyte-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Lock "cinder-quobyte-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:07 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ba54a1-6d1a-4172-9a17-7761df1653ce]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:07 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 Jul 07 18:09:07 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:08 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9" returned: 0 in 0.645s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e0cb10-21e5-4200-a34c-394c67f74880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de70f155-1f2f-45cb-bd6f-91ca019209e9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ac5794-e365-44a0-b914-c7dc6f153628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:08 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Volume volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 (de70f155-1f2f-45cb-bd6f-91ca019209e9): created successfully Jul 07 18:09:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ac5794-e365-44a0-b914-c7dc6f153628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Flow 'volume_create_manager' (d944d526-fce6-4491-928d-4f3cbccec158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c05fdd2e-d23b-463a-b041-d025ec4b55ee tempest-VolumesServicesTestJSON-1836302615 None] Created volume successfully. Jul 07 18:09:08 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" returned: 0 in 0.775s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:08 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103 Jul 07 18:09:08 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:09 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" returned: 0 in 0.627s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Lock "cinder-quobyte-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103" released by "delete_volume" :: held 1.443s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Created reservations ['8ab47a8a-2d26-46b0-ad1d-7c075188d7ae', '0c64c9c5-1b7f-43ee-a3f2-eff78c0110c2', '895ac7a5-dd7a-4d1f-90dc-85a53d270e8a', '972ad2f2-4201-4e14-8ad8-827116d4ef87'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Acquiring lock "cinder-de70f155-1f2f-45cb-bd6f-91ca019209e9-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Lock "cinder-de70f155-1f2f-45cb-bd6f-91ca019209e9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Acquiring lock "cinder-quobyte-de70f155-1f2f-45cb-bd6f-91ca019209e9" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:09 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:09 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Lock "cinder-quobyte-de70f155-1f2f-45cb-bd6f-91ca019209e9" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e489bf39-4c4e-40dd-b16d-7db49bea1d53]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:09 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 Jul 07 18:09:09 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:10 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.685s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Deleted volume successfully. Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ac40c4fb-0478-4fc9-96be-f1458a6a4e3b tempest-VolumesActionsTest-1378495400 None] Lock "cinder-d9f1d8f7-bb9b-437b-aedf-3fa92d0ca103-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Acquiring lock "cinder-930b2821-a99b-42af-8dbb-83d3ad9a099b-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "cinder-930b2821-a99b-42af-8dbb-83d3ad9a099b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Acquiring lock "cinder-quobyte-930b2821-a99b-42af-8dbb-83d3ad9a099b" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:10 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9" returned: 0 in 0.863s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "cinder-quobyte-930b2821-a99b-42af-8dbb-83d3ad9a099b" acquired by "delete_volume" :: waited 0.034s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:10 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9 Jul 07 18:09:10 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc06e69-8336-4da4-a953-d13c881a157d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:10 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b Jul 07 18:09:10 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:11 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de70f155-1f2f-45cb-bd6f-91ca019209e9" returned: 0 in 0.725s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Lock "cinder-quobyte-de70f155-1f2f-45cb-bd6f-91ca019209e9" released by "delete_volume" :: held 1.661s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Created reservations ['3d425151-5f15-4524-92c5-e9146c08c573', 'ef824d14-99f5-40c0-818b-ee440562b6c4', '9c74f436-f542-4208-b628-4dc908725531', '1d72d712-da99-4e62-b3a0-7627a67fceef'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:11 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:11 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:11 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b" returned: 0 in 0.899s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:11 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b Jul 07 18:09:11 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:11 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:11 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:12 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Deleted volume successfully. Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a4472eac-781e-43de-ab03-7cffdcbdda24 tempest-VolumesServicesTestJSON-1836302615 None] Lock "cinder-de70f155-1f2f-45cb-bd6f-91ca019209e9-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:12 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-930b2821-a99b-42af-8dbb-83d3ad9a099b" returned: 0 in 0.788s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "cinder-quobyte-930b2821-a99b-42af-8dbb-83d3ad9a099b" released by "delete_volume" :: held 1.750s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Created reservations ['dc671ea4-006f-41ca-b737-f11a81b5cae2', '05c87fef-7c0d-43a4-8b94-96d50c419c1e', '8e96e184-7147-40b8-9c2d-c1349dfb59ee', 'a04f98da-ccf9-45fa-b729-a06e1d9b679e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:12 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:12 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:12 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:12 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:13 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.813s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Deleted volume successfully. Jul 07 18:09:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1257ffa4-dfc7-438a-ae55-5970967363c8 tempest-AttachVolumeShelveTestJSON-407607550 None] Lock "cinder-930b2821-a99b-42af-8dbb-83d3ad9a099b-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:13 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:09:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:09:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Flow 'volume_create_manager' (2520bd18-49b1-47ca-9859-702dbbe3b07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c20b519-818d-4953-be88-4920954f0442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c20b519-818d-4953-be88-4920954f0442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2134787819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd5dd3b-c696-44d2-84d2-bdf26dafc357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708974c5941a4fdaa165a16840c4a704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:18Z,use_quota=True,user_id='cec3da59404e467fb0817d6cf7a42a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12f8958-4f23-4860-b54b-2614c034105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12f8958-4f23-4860-b54b-2614c034105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428efbf9-2f55-42cc-879c-c18142d7807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.image.glance [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Creating Keystone auth plugin from conf {{(pid=86972) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (428efbf9-2f55-42cc-879c-c18142d7807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bd5dd3b-c696-44d2-84d2-bdf26dafc357', 'volume_name': 'volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0505864f-c0b9-4c7c-a1c6-2c1bed86087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0505864f-c0b9-4c7c-a1c6-2c1bed86087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584f8491-b6b2-4ffc-9509-029ff691bdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:18 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Volume 0bd5dd3b-c696-44d2-84d2-bdf26dafc357: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 18:09:18 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Trying to clone 0bd5dd3b-c696-44d2-84d2-bdf26dafc357 from image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]). {{(pid=86972) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 18:09:19 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:09:19 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Image download 20.69 MB at 20.69 MB/s Jul 07 18:09:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7259fc2e-ffc4-48f1-8d97-5de32455239a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:19 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD Jul 07 18:09:19 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:20 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:20 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Temporary image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 is fetched for user cec3da59404e467fb0817d6cf7a42a9a. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:09:20 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5f3387-bb13-4e82-a75e-c9192cc79c6b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:20 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD Jul 07 18:09:20 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:21 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2134787819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd5dd3b-c696-44d2-84d2-bdf26dafc357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708974c5941a4fdaa165a16840c4a704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:18Z,use_quota=True,user_id='cec3da59404e467fb0817d6cf7a42a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Creating volume 0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:21 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:21 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 1073741824 Jul 07 18:09:21 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Flow 'volume_create_manager' (4722255f-07c0-48e0-a6e0-61ce3f10b47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2616347-110d-4c08-a58b-ba39c1b2e7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2616347-110d-4c08-a58b-ba39c1b2e7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1286921194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbb33ce-a844-4ac2-8ff9-58d1e902099a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fe1ad89cc884725ac72d8efc2f27ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:22Z,use_quota=True,user_id='347547b0c0754ccda9eaf2d6460cdc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccee191d-05da-4336-990d-02992cadad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccee191d-05da-4336-990d-02992cadad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b2a81c-31b7-4260-9491-3e8a4703f198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b2a81c-31b7-4260-9491-3e8a4703f198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fbb33ce-a844-4ac2-8ff9-58d1e902099a', 'volume_name': 'volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1b89ae-44fa-48e2-b98a-284f2431ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1b89ae-44fa-48e2-b98a-284f2431ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5512baf-97c4-4970-917d-4fa73b487d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:21 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Volume 5fbb33ce-a844-4ac2-8ff9-58d1e902099a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a', 'volume_size': 1} Jul 07 18:09:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:22 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 1073741824" returned: 0 in 1.022s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:22 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 Jul 07 18:09:22 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:22 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" returned: 0 in 0.766s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.044s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1286921194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fbb33ce-a844-4ac2-8ff9-58d1e902099a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6fe1ad89cc884725ac72d8efc2f27ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:22Z,use_quota=True,user_id='347547b0c0754ccda9eaf2d6460cdc79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Creating volume 5fbb33ce-a844-4ac2-8ff9-58d1e902099a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:22 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:22 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a 1073741824 Jul 07 18:09:22 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Attempting download of 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}])) to volume 0bd5dd3b-c696-44d2-84d2-bdf26dafc357. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[524685d5-46a3-4db5-8296-98ba7471e436]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_rm40593c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:23 devstack sudo[96144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_rm40593c Jul 07 18:09:23 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:23 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_rm40593c" returned: 0 in 0.833s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_rm40593c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:23 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a 1073741824" returned: 0 in 0.978s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:23 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a Jul 07 18:09:23 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:23 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_rm40593c Jul 07 18:09:23 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:24 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a" returned: 0 in 0.722s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:24 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5512baf-97c4-4970-917d-4fa73b487d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493a0f25-b133-4192-856a-e7015cece467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_rm40593c" returned: 1 in 0.827s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_rm40593c' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ffda32-c404-4c58-8d09-1cbf2011859b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:24 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Volume volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a (5fbb33ce-a844-4ac2-8ff9-58d1e902099a): created successfully Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493a0f25-b133-4192-856a-e7015cece467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Flow 'volume_create_manager' (4722255f-07c0-48e0-a6e0-61ce3f10b47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-89917aba-8e0b-41d4-b890-60238bdd5618 req-905322e3-fce1-4744-9a19-97af2416a5ea tempest-VolumesGetTestJSON-515537455 None] Created volume successfully. Jul 07 18:09:24 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD Jul 07 18:09:24 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Acquiring lock "cinder-5fbb33ce-a844-4ac2-8ff9-58d1e902099a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Lock "cinder-5fbb33ce-a844-4ac2-8ff9-58d1e902099a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Acquiring lock "cinder-quobyte-5fbb33ce-a844-4ac2-8ff9-58d1e902099a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Lock "cinder-quobyte-5fbb33ce-a844-4ac2-8ff9-58d1e902099a" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[6259fa4d-08d1-406f-aa0c-3fd1803d49d1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:25 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 was qcow2, converting to raw {{(pid=86972) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:25 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 Jul 07 18:09:25 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:25 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a Jul 07 18:09:25 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Flow 'volume_create_manager' (83d2714e-d7a2-411d-be25-6c4f2818c25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26180a01-f14f-452f-a976-1a63ca9598dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26180a01-f14f-452f-a976-1a63ca9598dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1326494407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3f71ac-1607-4f97-9f46-ec6aba2d2d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497cf37b996447dd8bac08005149a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:26Z,use_quota=True,user_id='1bea162d181e4849a376ec04a2f22b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6c9048-5bf1-43ac-a6b1-ddd8d6a00679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6c9048-5bf1-43ac-a6b1-ddd8d6a00679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16819f74-a965-4a02-9e1a-f1d8e8a75bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16819f74-a965-4a02-9e1a-f1d8e8a75bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3f71ac-1607-4f97-9f46-ec6aba2d2d34', 'volume_name': 'volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d98a07-1201-473b-bbc7-1b920678d103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d98a07-1201-473b-bbc7-1b920678d103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d577b3-d01a-4b84-9d1a-176b02d3049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:25 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Volume 5c3f71ac-1607-4f97-9f46-ec6aba2d2d34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34', 'volume_size': 1} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1326494407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3f71ac-1607-4f97-9f46-ec6aba2d2d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497cf37b996447dd8bac08005149a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:26Z,use_quota=True,user_id='1bea162d181e4849a376ec04a2f22b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Creating volume 5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:25 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:25 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 1073741824 Jul 07 18:09:25 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:26 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a" returned: 0 in 0.790s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:26 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a Jul 07 18:09:26 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:26 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 1073741824" returned: 0 in 0.961s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:26 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 Jul 07 18:09:26 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:27 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5fbb33ce-a844-4ac2-8ff9-58d1e902099a" returned: 0 in 0.717s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Lock "cinder-quobyte-5fbb33ce-a844-4ac2-8ff9-58d1e902099a" released by "delete_volume" :: held 1.573s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.quota [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Created reservations ['93a07f55-19f2-42b7-acc8-31fd3c7e7ae1', '49440b2c-a5c6-4d51-85f5-4f7ceb8a8dbe', '9b4a8fdd-33b5-4444-be3b-eafc42449b8a', '7dc472fc-55b2-4872-84c9-49f3bcb32cd4'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:27 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:27 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:27 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34" returned: 0 in 0.668s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d577b3-d01a-4b84-9d1a-176b02d3049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e1219f-68e1-4394-a0f9-ceb7de005d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:27 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Volume volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 (5c3f71ac-1607-4f97-9f46-ec6aba2d2d34): created successfully Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2e1219f-68e1-4394-a0f9-ceb7de005d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:27 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Flow 'volume_create_manager' (83d2714e-d7a2-411d-be25-6c4f2818c25b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" returned: 0 in 2.001s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ysvkgxnudevstack@QuobyteHD, size 112.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:09:27 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Converted 112.00 MB image at 55.91 MB/s Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9d0d4d65-6e6e-484d-828f-9e375a27de19 tempest-VolumesListAdminTestJSON-360803288 None] Created volume successfully. Jul 07 18:09:27 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 1G Jul 07 18:09:27 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:27 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.753s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.manager [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Deleted volume successfully. Jul 07 18:09:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-a43621fa-8630-455e-bdab-d32e86128224 req-b90bd958-e7b3-4521-bc5b-bc5d70536f0f tempest-VolumesGetTestJSON-515537455 None] Lock "cinder-5fbb33ce-a844-4ac2-8ff9-58d1e902099a-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:28 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 1G" returned: 0 in 0.763s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf709cc-477e-4827-bf87-76993561932c]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Flow 'volume_create_manager' (aa3207ff-abd5-4375-85ea-df8b2e9bb70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b42b0f-0516-490b-9143-291425abc8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99b42b0f-0516-490b-9143-291425abc8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1340206046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308341fe-4223-4c0e-9996-585937b1fd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497cf37b996447dd8bac08005149a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:28Z,use_quota=True,user_id='1bea162d181e4849a376ec04a2f22b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25bbdf3-ba78-48ce-a72b-8ab79a92f2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:28 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 Jul 07 18:09:28 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25bbdf3-ba78-48ce-a72b-8ab79a92f2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b77e73d-0618-4117-bd47-0f79f51dc5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b77e73d-0618-4117-bd47-0f79f51dc5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308341fe-4223-4c0e-9996-585937b1fd01', 'volume_name': 'volume-308341fe-4223-4c0e-9996-585937b1fd01', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac9509c-8195-4f88-aaa7-0da18a5c3c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac9509c-8195-4f88-aaa7-0da18a5c3c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5822a377-5f3c-4916-824d-1234b1623cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:28 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Volume 308341fe-4223-4c0e-9996-585937b1fd01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308341fe-4223-4c0e-9996-585937b1fd01', 'volume_size': 1} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1340206046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308341fe-4223-4c0e-9996-585937b1fd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497cf37b996447dd8bac08005149a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:28Z,use_quota=True,user_id='1bea162d181e4849a376ec04a2f22b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Creating volume 308341fe-4223-4c0e-9996-585937b1fd01 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:28 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:28 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01 1073741824 Jul 07 18:09:28 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:29 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" returned: 0 in 0.803s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:29 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 Jul 07 18:09:29 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:29 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01 1073741824" returned: 0 in 0.953s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:29 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01 Jul 07 18:09:29 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:30 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" returned: 1 in 0.875s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Downloaded image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}])) to volume 0bd5dd3b-c696-44d2-84d2-bdf26dafc357 successfully. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Temporary image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 for user cec3da59404e467fb0817d6cf7a42a9a is deleted. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Marking volume 0bd5dd3b-c696-44d2-84d2-bdf26dafc357 as bootable. {{(pid=86972) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Copying metadata from image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 to 0bd5dd3b-c696-44d2-84d2-bdf26dafc357. {{(pid=86972) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Creating volume glance metadata for volume 0bd5dd3b-c696-44d2-84d2-bdf26dafc357 backed by image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86972) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584f8491-b6b2-4ffc-9509-029ff691bdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce5468f-f8d1-4b7d-ac96-9278d8a4cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:30 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Volume volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 (0bd5dd3b-c696-44d2-84d2-bdf26dafc357): created successfully Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce5468f-f8d1-4b7d-ac96-9278d8a4cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Flow 'volume_create_manager' (2520bd18-49b1-47ca-9859-702dbbe3b07f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:30 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f6984e89-9ed7-4b65-8860-111b6030d23d tempest-VolumesExtendTest-1132749601 None] Created volume successfully. Jul 07 18:09:30 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01" returned: 0 in 0.686s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5822a377-5f3c-4916-824d-1234b1623cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308341fe-4223-4c0e-9996-585937b1fd01', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e98cc6e-59da-4eda-9a98-4775c99e455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:30 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Volume volume-308341fe-4223-4c0e-9996-585937b1fd01 (308341fe-4223-4c0e-9996-585937b1fd01): created successfully Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e98cc6e-59da-4eda-9a98-4775c99e455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Flow 'volume_create_manager' (aa3207ff-abd5-4375-85ea-df8b2e9bb70b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:30 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4bad0c10-a2e3-4eb1-98b5-365ae4357386 tempest-VolumesListAdminTestJSON-360803288 None] Created volume successfully. Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Flow 'volume_create_manager' (7a9bc317-4dac-4b29-97b9-3120fbc6da00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2805fe71-b4ca-4ccc-8156-7d6748a83101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2805fe71-b4ca-4ccc-8156-7d6748a83101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-45177781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8418c7-9200-42ef-b6f6-5f05cac9c195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497cf37b996447dd8bac08005149a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:31Z,use_quota=True,user_id='1bea162d181e4849a376ec04a2f22b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2174cd-b697-4d69-a1b3-9da4d8b81cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2174cd-b697-4d69-a1b3-9da4d8b81cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4f64ee-a429-4fb2-a963-e2051eec163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4f64ee-a429-4fb2-a963-e2051eec163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a8418c7-9200-42ef-b6f6-5f05cac9c195', 'volume_name': 'volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cedb45-9880-49e6-ac2d-5025f57b8986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cedb45-9880-49e6-ac2d-5025f57b8986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0040ee-9814-45bf-91a5-0da1b4acbdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:31 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Volume 4a8418c7-9200-42ef-b6f6-5f05cac9c195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195', 'volume_size': 1} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-45177781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a8418c7-9200-42ef-b6f6-5f05cac9c195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='497cf37b996447dd8bac08005149a360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:31Z,use_quota=True,user_id='1bea162d181e4849a376ec04a2f22b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Creating volume 4a8418c7-9200-42ef-b6f6-5f05cac9c195 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:31 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:31 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 1073741824 Jul 07 18:09:31 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:31 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 1073741824" returned: 0 in 0.881s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:32 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 Jul 07 18:09:32 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:32 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195" returned: 0 in 0.666s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.237s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0040ee-9814-45bf-91a5-0da1b4acbdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd02bcc-78ab-4243-8e52-1a5fe77f5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:32 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Volume volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 (4a8418c7-9200-42ef-b6f6-5f05cac9c195): created successfully Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd02bcc-78ab-4243-8e52-1a5fe77f5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Flow 'volume_create_manager' (7a9bc317-4dac-4b29-97b9-3120fbc6da00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43edb19-bc5f-4684-bd0b-a62e1ef902f2]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:32 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6c1b6630-80b5-431e-9856-533f8c0db8e7 tempest-VolumesListAdminTestJSON-360803288 None] Created volume successfully. Jul 07 18:09:32 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 Jul 07 18:09:32 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:33 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" returned: 0 in 0.837s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:33 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 Jul 07 18:09:33 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Flow 'volume_create_manager' (91952bef-4e75-4c38-837e-6943d2d408b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d355a8ce-d966-44ba-9848-1fb8b781cb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d355a8ce-d966-44ba-9848-1fb8b781cb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af9f41b-bac8-48f8-a5c3-774db8d17201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58dd134cb32041fca3ec904bf17d013a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:34Z,use_quota=True,user_id='6bf29dc9a926468d8c6d9b1f69e3922d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a4035e-56ec-4f49-96f2-e594414fc1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a4035e-56ec-4f49-96f2-e594414fc1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baf82fa-ea70-4dbf-b89b-0b12221dff88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baf82fa-ea70-4dbf-b89b-0b12221dff88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af9f41b-bac8-48f8-a5c3-774db8d17201', 'volume_name': 'volume-4af9f41b-bac8-48f8-a5c3-774db8d17201', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2da4bd8-476d-4626-a495-12fcdcc81485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2da4bd8-476d-4626-a495-12fcdcc81485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8204dee6-494d-40c3-aeba-925f7ee80b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:34 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Volume 4af9f41b-bac8-48f8-a5c3-774db8d17201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af9f41b-bac8-48f8-a5c3-774db8d17201', 'volume_size': 1} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:34 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" returned: 1 in 0.976s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 2G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 2G" returned: 0 in 0.077s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.963s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.497s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af9f41b-bac8-48f8-a5c3-774db8d17201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58dd134cb32041fca3ec904bf17d013a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:34Z,use_quota=True,user_id='6bf29dc9a926468d8c6d9b1f69e3922d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Creating volume 4af9f41b-bac8-48f8-a5c3-774db8d17201 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:34 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:34 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 1073741824 Jul 07 18:09:34 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:34 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4fb00824-4417-4b71-a3dd-60e41acc7434 tempest-VolumesExtendTest-1132749601 None] Extend volume completed successfully. Jul 07 18:09:35 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 1073741824" returned: 0 in 0.892s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:35 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 Jul 07 18:09:35 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Acquiring lock "cinder-0bd5dd3b-c696-44d2-84d2-bdf26dafc357-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Lock "cinder-0bd5dd3b-c696-44d2-84d2-bdf26dafc357-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Acquiring lock "cinder-quobyte-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Lock "cinder-quobyte-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba428d1-aac8-42ac-8d66-9c7d1578002c]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:36 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201" returned: 0 in 0.707s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8204dee6-494d-40c3-aeba-925f7ee80b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af9f41b-bac8-48f8-a5c3-774db8d17201', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fa0be1-0ac1-4df1-b131-c72d5451f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:36 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 Jul 07 18:09:36 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:36 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Volume volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 (4af9f41b-bac8-48f8-a5c3-774db8d17201): created successfully Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88fa0be1-0ac1-4df1-b131-c72d5451f643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Flow 'volume_create_manager' (91952bef-4e75-4c38-837e-6943d2d408b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:36 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fe81bdcd-958d-4ac0-8502-89b4f7ed4dd3 tempest-VolumesListAdminTestJSON-1961049434 None] Created volume successfully. Jul 07 18:09:36 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" returned: 0 in 0.780s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:37 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 Jul 07 18:09:37 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Acquiring lock "cinder-4af9f41b-bac8-48f8-a5c3-774db8d17201-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "cinder-4af9f41b-bac8-48f8-a5c3-774db8d17201-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=54,cinder:UPDATE=67,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Acquiring lock "cinder-quobyte-4af9f41b-bac8-48f8-a5c3-774db8d17201" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "cinder-quobyte-4af9f41b-bac8-48f8-a5c3-774db8d17201" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7a0562-19d9-419d-9624-6346d83a0156]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "cinder-4a8418c7-9200-42ef-b6f6-5f05cac9c195-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-4a8418c7-9200-42ef-b6f6-5f05cac9c195-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "cinder-quobyte-4a8418c7-9200-42ef-b6f6-5f05cac9c195" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-quobyte-4a8418c7-9200-42ef-b6f6-5f05cac9c195" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd874190-0f06-4efe-9384-0c291904a2a7]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:37 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 Jul 07 18:09:37 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:37 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 Jul 07 18:09:37 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:37 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" returned: 1 in 0.905s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:09:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:37 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357 Jul 07 18:09:37 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:38 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201" returned: 0 in 0.887s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:38 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201 Jul 07 18:09:38 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:38 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195" returned: 0 in 0.886s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:38 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195 Jul 07 18:09:38 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:38 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" returned: 0 in 0.784s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Lock "cinder-quobyte-0bd5dd3b-c696-44d2-84d2-bdf26dafc357" released by "delete_volume" :: held 2.552s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=57,cinder:UPDATE=73,cinder:INSERT=20,cinder:DELETE=6 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Created reservations ['47882475-5b44-4107-a4af-8c088671a4dc', 'e1a693e8-5d92-4050-a0bc-fbbb8ab4242d', '1c515564-0d05-43b1-8633-b946ccefc997', 'd41a68cb-dd7a-40e7-9396-6911073e34ee'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:38 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:38 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:39 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4af9f41b-bac8-48f8-a5c3-774db8d17201" returned: 0 in 0.804s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "cinder-quobyte-4af9f41b-bac8-48f8-a5c3-774db8d17201" released by "delete_volume" :: held 1.766s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Created reservations ['f00af25f-bb17-4911-b951-80d362a2150a', '9cb2db47-3af7-475e-a45f-4c09aba6d3c4', 'f2a297ba-33b8-4124-9b4f-f372bfdcf80b', 'c58b2240-88a1-4d6a-b1a8-64354a176eed'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:39 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a8418c7-9200-42ef-b6f6-5f05cac9c195" returned: 0 in 0.838s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-quobyte-4a8418c7-9200-42ef-b6f6-5f05cac9c195" released by "delete_volume" :: held 1.795s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:39 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:39 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Created reservations ['61b3f2e1-f3cb-408e-b483-50d93d669ee9', '7a5aa9c5-dade-489e-955d-2bc2b6ceae4e', '3f281b22-f60f-466b-a334-0b51a8306f60', 'd8b96798-68f8-4643-9e8e-8228cd74142d'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:39 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:39 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Flow 'volume_create_manager' (77a89171-b0ae-4691-a1a7-f1c637bcffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaa0b00-5983-4eea-a862-8daa7bb5f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:39 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaa0b00-5983-4eea-a862-8daa7bb5f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-733162599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d41db6b-2c49-4a3a-b051-12a166c076ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7ea3464da54db195ee47e87512f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:40Z,use_quota=True,user_id='dd80a990c3e54a20adb439285e3f9810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c466478-606a-45d5-9366-d225bb3cd91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c466478-606a-45d5-9366-d225bb3cd91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a366a9ee-7966-40fb-b9d4-25e332be29dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a366a9ee-7966-40fb-b9d4-25e332be29dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d41db6b-2c49-4a3a-b051-12a166c076ec', 'volume_name': 'volume-8d41db6b-2c49-4a3a-b051-12a166c076ec', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf2b3c9-9342-46b8-b875-1ea7b81ad69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faf2b3c9-9342-46b8-b875-1ea7b81ad69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db30238b-e14e-4b68-8edb-e86c8ef6c942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:39 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Volume 8d41db6b-2c49-4a3a-b051-12a166c076ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d41db6b-2c49-4a3a-b051-12a166c076ec', 'volume_size': 1} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-733162599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d41db6b-2c49-4a3a-b051-12a166c076ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7ea3464da54db195ee47e87512f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:40Z,use_quota=True,user_id='dd80a990c3e54a20adb439285e3f9810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Creating volume 8d41db6b-2c49-4a3a-b051-12a166c076ec {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:39 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "cinder-308341fe-4223-4c0e-9996-585937b1fd01-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.060s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:39 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec 1073741824 Jul 07 18:09:39 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:39 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Deleted volume successfully. Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-308341fe-4223-4c0e-9996-585937b1fd01-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4ac296c9-267b-4b68-9df3-bdf83206997f tempest-VolumesExtendTest-1132749601 None] Lock "cinder-0bd5dd3b-c696-44d2-84d2-bdf26dafc357-delete_volume" released by "delete_volume" :: held 3.972s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "cinder-quobyte-308341fe-4223-4c0e-9996-585937b1fd01" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-quobyte-308341fe-4223-4c0e-9996-585937b1fd01" acquired by "delete_volume" :: waited 0.035s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6204952-922d-429c-abc4-c2820c4bd56c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:40 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01 Jul 07 18:09:40 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Flow 'volume_create_manager' (0c52754d-7222-42d8-8b3c-6cd911a5ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9df206-1e0d-4656-b477-b2366d70b354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d9df206-1e0d-4656-b477-b2366d70b354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1044932445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db353856-ce6b-4567-a49f-7daa74ef276a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708974c5941a4fdaa165a16840c4a704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:40Z,use_quota=True,user_id='cec3da59404e467fb0817d6cf7a42a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c45e89-0ec5-4eaa-8e1a-8d7d9d7328e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c45e89-0ec5-4eaa-8e1a-8d7d9d7328e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3641b47e-831d-44f4-b9fc-dff48acdcc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3641b47e-831d-44f4-b9fc-dff48acdcc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db353856-ce6b-4567-a49f-7daa74ef276a', 'volume_name': 'volume-db353856-ce6b-4567-a49f-7daa74ef276a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704b926b-5ac7-4595-988f-18bfde922f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704b926b-5ac7-4595-988f-18bfde922f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db16119-a993-436d-b701-27d364012cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:40 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Volume db353856-ce6b-4567-a49f-7daa74ef276a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db353856-ce6b-4567-a49f-7daa74ef276a', 'volume_size': 1} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:40 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.200s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Deleted volume successfully. Jul 07 18:09:40 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-73e4aa6f-a07c-4bae-aaa4-e2247a21bf50 tempest-VolumesListAdminTestJSON-1961049434 None] Lock "cinder-4af9f41b-bac8-48f8-a5c3-774db8d17201-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.999s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Deleted volume successfully. Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88ea5324-f8cb-4906-b497-850e5e824a6c tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-4a8418c7-9200-42ef-b6f6-5f05cac9c195-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:40 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec 1073741824" returned: 0 in 1.042s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:41 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec Jul 07 18:09:41 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:41 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01" returned: 0 in 1.082s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:41 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01 Jul 07 18:09:41 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:41 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec" returned: 0 in 0.733s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1044932445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db353856-ce6b-4567-a49f-7daa74ef276a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='708974c5941a4fdaa165a16840c4a704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:40Z,use_quota=True,user_id='cec3da59404e467fb0817d6cf7a42a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Creating volume db353856-ce6b-4567-a49f-7daa74ef276a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:41 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db30238b-e14e-4b68-8edb-e86c8ef6c942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d41db6b-2c49-4a3a-b051-12a166c076ec', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:41 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a 1073741824 Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9f8087-3502-4e7f-a032-7de9de3e78a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:41 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:41 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Volume volume-8d41db6b-2c49-4a3a-b051-12a166c076ec (8d41db6b-2c49-4a3a-b051-12a166c076ec): created successfully Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9f8087-3502-4e7f-a032-7de9de3e78a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Flow 'volume_create_manager' (77a89171-b0ae-4691-a1a7-f1c637bcffb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:41 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b31ee2b7-aad3-4e01-8e28-d339f7edced2 tempest-VolumeQuotasAdminTestJSON-13422280 None] Created volume successfully. Jul 07 18:09:41 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-308341fe-4223-4c0e-9996-585937b1fd01" returned: 0 in 0.675s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-quobyte-308341fe-4223-4c0e-9996-585937b1fd01" released by "delete_volume" :: held 1.825s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:41 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Created reservations ['e1aff3e4-6967-443f-95e0-a8e9e76b4aa8', '7d3dd9ce-8ce0-43c9-803e-0ba4835803f4', 'eb33d354-f696-4fa6-88f5-7e0da26ff769', 'db28309d-1fe8-4cda-aea5-33ad9e8ffb2e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:42 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:42 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "cinder-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "cinder-quobyte-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-quobyte-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c69d620-5d3d-46ab-8920-5a65ccb92880]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:42 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 Jul 07 18:09:42 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:42 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a 1073741824" returned: 0 in 0.937s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:42 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a Jul 07 18:09:42 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:42 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.809s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Deleted volume successfully. Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b1560f21-7407-4c03-b22a-7b9be86816ed tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-308341fe-4223-4c0e-9996-585937b1fd01-delete_volume" released by "delete_volume" :: held 2.907s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Acquiring lock "cinder-8d41db6b-2c49-4a3a-b051-12a166c076ec-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "cinder-8d41db6b-2c49-4a3a-b051-12a166c076ec-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Acquiring lock "cinder-quobyte-8d41db6b-2c49-4a3a-b051-12a166c076ec" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "cinder-quobyte-8d41db6b-2c49-4a3a-b051-12a166c076ec" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6abf80f-63d3-47f7-90cc-8db4ed85e904]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:43 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec Jul 07 18:09:43 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:43 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34" returned: 0 in 0.814s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:43 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34 Jul 07 18:09:43 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:43 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a" returned: 0 in 0.751s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8db16119-a993-436d-b701-27d364012cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db353856-ce6b-4567-a49f-7daa74ef276a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48d68b0-3f34-447a-b0d4-9cbd6cade8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:43 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Volume volume-db353856-ce6b-4567-a49f-7daa74ef276a (db353856-ce6b-4567-a49f-7daa74ef276a): created successfully Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48d68b0-3f34-447a-b0d4-9cbd6cade8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Flow 'volume_create_manager' (0c52754d-7222-42d8-8b3c-6cd911a5ac66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:43 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-20365b05-70e8-46f4-8a3c-9c5039b2fc25 tempest-VolumesExtendTest-1132749601 None] Created volume successfully. Jul 07 18:09:43 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec" returned: 0 in 0.783s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:43 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec Jul 07 18:09:43 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:43 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34" returned: 0 in 0.736s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-quobyte-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34" released by "delete_volume" :: held 1.594s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Created reservations ['a4e7a9c5-bc83-4eb3-a61a-a296b41db0e7', '22a3aba3-1e9a-4a9a-9c5c-94fb160c7dc4', 'a0c8298c-a557-4a08-abe3-14e2b418ab0c', '33c37eda-7d90-4087-bd5f-f2bacbdea772'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:44 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:44 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:44 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8d41db6b-2c49-4a3a-b051-12a166c076ec" returned: 0 in 0.663s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "cinder-quobyte-8d41db6b-2c49-4a3a-b051-12a166c076ec" released by "delete_volume" :: held 1.492s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Created reservations ['b70dcb03-0708-4122-b859-ff3e7b547230', 'fe0a81d9-b401-4777-92ea-a2e7a901dd45', '4f8a4498-b52a-4737-a77f-78e5591e0c5d', 'e25660a1-feb8-4b20-84a3-3c3e400a5f09'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:44 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:44 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Creating offline snapshot 1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 of volume db353856-ce6b-4567-a49f-7daa74ef276a {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3f70c4-cc77-4f6a-8b04-dcd809452092]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:44 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a Jul 07 18:09:44 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:44 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.780s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Deleted volume successfully. Jul 07 18:09:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6cf25971-01e3-46bc-8e2d-a1d5bd243985 tempest-VolumesListAdminTestJSON-360803288 None] Lock "cinder-5c3f71ac-1607-4f97-9f46-ec6aba2d2d34-delete_volume" released by "delete_volume" :: held 2.615s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:45 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.719s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:45 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Deleted volume successfully. Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89c65964-58fc-4a2e-8e66-e05ed9b2b30b tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "cinder-8d41db6b-2c49-4a3a-b051-12a166c076ec-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:45 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a" returned: 0 in 0.885s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:45 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 1G Jul 07 18:09:45 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Flow 'volume_create_manager' (564ba367-fcbf-45bc-b970-13940ccd9938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2781ea-7565-4488-8a38-d9314526cc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2781ea-7565-4488-8a38-d9314526cc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1086186830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65343605-8ae5-4231-92ca-6124ea668342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7ea3464da54db195ee47e87512f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:46Z,use_quota=True,user_id='dd80a990c3e54a20adb439285e3f9810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a1cb35-ace4-4c7f-a0e5-2bcdba46abf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a1cb35-ace4-4c7f-a0e5-2bcdba46abf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b29b9e-666f-4bd6-8f58-8b23538ef949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b29b9e-666f-4bd6-8f58-8b23538ef949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65343605-8ae5-4231-92ca-6124ea668342', 'volume_name': 'volume-65343605-8ae5-4231-92ca-6124ea668342', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3bd881d-8f0f-44ef-b3b6-2ddf8265b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3bd881d-8f0f-44ef-b3b6-2ddf8265b182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b974913-18f8-4913-b980-2912c5cf4b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:45 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Volume 65343605-8ae5-4231-92ca-6124ea668342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65343605-8ae5-4231-92ca-6124ea668342', 'volume_size': 1} Jul 07 18:09:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:46 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 1G" returned: 0 in 0.915s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db353856-ce6b-4567-a49f-7daa74ef276a -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:46 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db353856-ce6b-4567-a49f-7daa74ef276a -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 Jul 07 18:09:46 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:47 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db353856-ce6b-4567-a49f-7daa74ef276a -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20" returned: 0 in 0.761s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:47 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 is being set with open permissions: ugo+rw Jul 07 18:09:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:47 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 Jul 07 18:09:47 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:47 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20" returned: 0 in 0.666s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:48 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.info Jul 07 18:09:48 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:48 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.info" returned: 0 in 0.775s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:48 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.info is being set with open permissions: ugo+rw Jul 07 18:09:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:48 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.info Jul 07 18:09:48 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:49 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.info" returned: 0 in 0.691s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.818s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.614s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1086186830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65343605-8ae5-4231-92ca-6124ea668342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7ea3464da54db195ee47e87512f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:46Z,use_quota=True,user_id='dd80a990c3e54a20adb439285e3f9810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Creating volume 65343605-8ae5-4231-92ca-6124ea668342 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:49 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:49 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342 1073741824 Jul 07 18:09:49 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:49 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a3ec96fa-217f-44a4-9434-d7629ba8593a tempest-VolumesExtendTest-1132749601 None] Create snapshot completed successfully Jul 07 18:09:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f77d6130-3b1a-48fe-9308-3eb7f9adc5c0 tempest-VolumesExtendTest-1132749601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:50 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342 1073741824" returned: 0 in 0.925s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:50 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342 Jul 07 18:09:50 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:51 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342" returned: 0 in 0.649s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f77d6130-3b1a-48fe-9308-3eb7f9adc5c0 tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.917s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b974913-18f8-4913-b980-2912c5cf4b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65343605-8ae5-4231-92ca-6124ea668342', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c255c6-5b6a-4196-a417-c4b45cbdaeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[953b5d6f-886d-407c-87e1-08adc1c8e569]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f77d6130-3b1a-48fe-9308-3eb7f9adc5c0 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:51 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Volume volume-65343605-8ae5-4231-92ca-6124ea668342 (65343605-8ae5-4231-92ca-6124ea668342): created successfully Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65c255c6-5b6a-4196-a417-c4b45cbdaeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Flow 'volume_create_manager' (564ba367-fcbf-45bc-b970-13940ccd9938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6bfed9f2-a831-4244-a61f-2dcf118fe36e tempest-VolumeQuotasAdminTestJSON-13422280 None] Created volume successfully. Jul 07 18:09:51 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a Jul 07 18:09:51 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Flow 'volume_create_manager' (e71182b5-3372-460c-9151-26b39e25b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156fe16e-a173-4ebd-993b-06ee22e73b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (156fe16e-a173-4ebd-993b-06ee22e73b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1136616889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6498a3a6-7fbb-4581-b8cd-39469bd4b566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8931a093382243b5ae7e581543954970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:52Z,use_quota=True,user_id='a68bfd4a5bb54764acc5f6383a2f3981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae167fd4-1664-4406-83ad-292a17ddc667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae167fd4-1664-4406-83ad-292a17ddc667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c0c7be-a487-4a2e-8c14-0a000a12e40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.image.glance [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Creating Keystone auth plugin from conf {{(pid=86972) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c0c7be-a487-4a2e-8c14-0a000a12e40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6498a3a6-7fbb-4581-b8cd-39469bd4b566', 'volume_name': 'volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2372ba1-3ef6-4884-94b8-d4905c839ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2372ba1-3ef6-4884-94b8-d4905c839ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a23a50-64e2-4547-b86c-b8bec2f6fc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:09:51 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Volume 6498a3a6-7fbb-4581-b8cd-39469bd4b566: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Trying to clone 6498a3a6-7fbb-4581-b8cd-39469bd4b566 from image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]). {{(pid=86972) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 18:09:51 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f77d6130-3b1a-48fe-9308-3eb7f9adc5c0 tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a" returned: 0 in 0.821s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f77d6130-3b1a-48fe-9308-3eb7f9adc5c0 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 2G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f77d6130-3b1a-48fe-9308-3eb7f9adc5c0 tempest-VolumesExtendTest-1132749601 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 2G" returned: 0 in 0.200s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f77d6130-3b1a-48fe-9308-3eb7f9adc5c0 tempest-VolumesExtendTest-1132749601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.078s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f77d6130-3b1a-48fe-9308-3eb7f9adc5c0 tempest-VolumesExtendTest-1132749601 None] Extend volume completed successfully. Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:09:52 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Image download 20.69 MB at 20.69 MB/s Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[52940877-4def-489b-9840-c2e3ad596e39]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:52 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD Jul 07 18:09:52 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Acquiring lock "cinder-1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Lock "cinder-1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Acquiring lock "cinder-quobyte-db353856-ce6b-4567-a49f-7daa74ef276a" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Lock "cinder-quobyte-db353856-ce6b-4567-a49f-7daa74ef276a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Acquiring lock "cinder-quobyte-1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Lock "cinder-quobyte-1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Deleting offline snapshot 1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 of volume db353856-ce6b-4567-a49f-7daa74ef276a {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] snapshot_file for this snap is: volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd91bf0d-ceac-4a44-ae9c-2842a1b5404c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:52 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 Jul 07 18:09:52 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-28d1439f-a4ea-4f2b-8641-d431eadc4209 tempest-VolumeQuotasAdminTestJSON-1404974500 None] Transfer volume completed successfully. Jul 07 18:09:53 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD" returned: 0 in 0.752s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:53 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Temporary image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 is fetched for user a68bfd4a5bb54764acc5f6383a2f3981. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:09:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a673bd2c-f34b-4682-8a6c-03faf9fb7477]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:53 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD Jul 07 18:09:53 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:53 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20" returned: 0 in 0.795s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db353856-ce6b-4567-a49f-7daa74ef276a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:09:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf9c483-17ee-49ed-8b84-05ba8856cf64]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:53 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a Jul 07 18:09:53 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Acquiring lock "cinder-65343605-8ae5-4231-92ca-6124ea668342-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Lock "cinder-65343605-8ae5-4231-92ca-6124ea668342-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:54 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1136616889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6498a3a6-7fbb-4581-b8cd-39469bd4b566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8931a093382243b5ae7e581543954970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:09:52Z,use_quota=True,user_id='a68bfd4a5bb54764acc5f6383a2f3981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Creating volume 6498a3a6-7fbb-4581-b8cd-39469bd4b566 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:09:54 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Acquiring lock "cinder-quobyte-65343605-8ae5-4231-92ca-6124ea668342" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:54 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 1073741824 Jul 07 18:09:54 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Lock "cinder-quobyte-65343605-8ae5-4231-92ca-6124ea668342" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[03227d3b-bd42-4adf-abd9-8c1c1ec344c2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:54 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342 Jul 07 18:09:54 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:54 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a" returned: 0 in 0.920s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:54 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 Jul 07 18:09:54 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:55 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 1073741824" returned: 0 in 0.954s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:55 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342" returned: 0 in 0.913s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:55 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342 Jul 07 18:09:55 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:55 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 Jul 07 18:09:55 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:55 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20" returned: 0 in 0.834s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:55 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20 Jul 07 18:09:55 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:55 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566" returned: 0 in 0.682s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:55 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-65343605-8ae5-4231-92ca-6124ea668342" returned: 0 in 0.724s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Lock "cinder-quobyte-65343605-8ae5-4231-92ca-6124ea668342" released by "delete_volume" :: held 1.690s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Attempting download of 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}])) to volume 6498a3a6-7fbb-4581-b8cd-39469bd4b566. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Created reservations ['d8a9115d-3647-4b12-bc47-491d78e476fb', 'a94e0c07-eab4-440a-aaef-eb0b56a272aa', 'fa3948c5-c883-4dd3-8750-8dc3c994d646', 'f7bbc58c-5245-49c2-bb5d-c0241f2313ca'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[648db0fd-30ac-44f8-a217-4b6860c8f790]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yat67906 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:56 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a.1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20" returned: 0 in 0.716s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:56 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:56 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:56 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yat67906 Jul 07 18:09:56 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Lock "cinder-quobyte-1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20" released by "_delete_snapshot" :: held 3.441s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Lock "cinder-quobyte-db353856-ce6b-4567-a49f-7daa74ef276a" released by "delete_snapshot" :: held 3.475s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Created reservations ['64088865-6cbf-4164-a66d-52c33a09b58e', '68abd81c-9881-4e07-a897-8e078bb61205', '5a583ad9-9d00-47a1-a359-7f5b3f64b207', '6f274d73-9a71-4026-9926-4340a4c3493d'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:56 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Delete snapshot completed successfully. Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f7911853-b4b4-4ec8-a5c6-955b2b7a4df3 tempest-VolumesExtendTest-1132749601 None] Lock "cinder-1a21eebf-5cc6-40f9-8efb-4cc0b8e55e20-delete_snapshot" released by "delete_snapshot" :: held 3.640s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:56 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yat67906" returned: 0 in 0.781s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yat67906 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:56 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.721s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:56 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Deleted volume successfully. Jul 07 18:09:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1aca1b44-d659-43fb-a7dd-bfcf0df4f2e2 tempest-VolumeQuotasAdminTestJSON-414624549 None] Lock "cinder-65343605-8ae5-4231-92ca-6124ea668342-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:56 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yat67906 Jul 07 18:09:56 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Acquiring lock "cinder-db353856-ce6b-4567-a49f-7daa74ef276a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Lock "cinder-db353856-ce6b-4567-a49f-7daa74ef276a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Acquiring lock "cinder-quobyte-db353856-ce6b-4567-a49f-7daa74ef276a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Lock "cinder-quobyte-db353856-ce6b-4567-a49f-7daa74ef276a" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[56297518-b09e-4e29-8711-12c0bc0fc6c6]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:57 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a Jul 07 18:09:57 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:57 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yat67906" returned: 1 in 0.818s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yat67906' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b22171-9257-410f-8c7b-847833dbfae1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:57 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD Jul 07 18:09:57 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:57 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a" returned: 0 in 0.818s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:57 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a Jul 07 18:09:57 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:58 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD" returned: 0 in 0.793s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 was qcow2, converting to raw {{(pid=86972) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:58 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 Jul 07 18:09:58 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:58 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db353856-ce6b-4567-a49f-7daa74ef276a" returned: 0 in 0.664s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Lock "cinder-quobyte-db353856-ce6b-4567-a49f-7daa74ef276a" released by "delete_volume" :: held 1.550s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Created reservations ['feac4306-f0b2-416b-b43b-3f1575b366b3', '5519d773-3a6c-440c-bb00-da0fc32d911a', 'e8c205f4-ea77-4fb2-9c00-53a569a7112f', '1475d6a1-ae30-44a9-be33-f0e951fd2690'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:09:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:09:58 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:09:58 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:09:59 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 07 18:09:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.763s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:09:59 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:09:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Deleted volume successfully. Jul 07 18:09:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3c6c44e2-524f-468c-a656-fa93f7e9b6eb tempest-VolumesExtendTest-1132749601 None] Lock "cinder-db353856-ce6b-4567-a49f-7daa74ef276a-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:00 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566" returned: 0 in 2.469s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:00 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_tvcszd20devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:10:00 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Converted 112.00 MB image at 45.35 MB/s Jul 07 18:10:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:00 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 1G Jul 07 18:10:00 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:01 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 1G" returned: 0 in 0.752s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75d28c1-083f-4e49-8c10-b4ca5b74d8cf]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:01 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 Jul 07 18:10:01 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:02 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566" returned: 0 in 0.835s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:02 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 Jul 07 18:10:02 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:03 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566" returned: 1 in 0.824s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Downloaded image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}])) to volume 6498a3a6-7fbb-4581-b8cd-39469bd4b566 successfully. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Temporary image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 for user a68bfd4a5bb54764acc5f6383a2f3981 is deleted. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Marking volume 6498a3a6-7fbb-4581-b8cd-39469bd4b566 as bootable. {{(pid=86972) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Copying metadata from image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 to 6498a3a6-7fbb-4581-b8cd-39469bd4b566. {{(pid=86972) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Creating volume glance metadata for volume 6498a3a6-7fbb-4581-b8cd-39469bd4b566 backed by image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86972) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a23a50-64e2-4547-b86c-b8bec2f6fc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4af4bdf-7546-45c0-96a8-7a006aa43c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:03 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Volume volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 (6498a3a6-7fbb-4581-b8cd-39469bd4b566): created successfully Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4af4bdf-7546-45c0-96a8-7a006aa43c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Flow 'volume_create_manager' (e71182b5-3372-460c-9151-26b39e25b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-371d5d33-6cab-4238-ad15-b4e07218f1b6 tempest-VolumesImageMetadata-685135844 None] Created volume successfully. Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Flow 'volume_create_manager' (ad6c3218-3387-4df8-a0ee-fc7691851d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff51074-e9af-465c-ac74-20d74d943182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff51074-e9af-465c-ac74-20d74d943182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1577902506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b674bdd-e8ff-4763-84dd-c818756d9459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead8d0e262b74a29b8f9c88ded6ebc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:04Z,use_quota=True,user_id='08dcc997ac3f4eb59e60d7d521525335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d13205-c33d-4426-98b4-7a5c094bbb5e),volume_type_id=32d13205-c33d-4426-98b4-7a5c094bbb5e)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a29080-4d3d-44ad-a0ea-b4d88f48843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a29080-4d3d-44ad-a0ea-b4d88f48843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7502f1-4e6d-46b0-b5a4-1e365edfc24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7502f1-4e6d-46b0-b5a4-1e365edfc24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b674bdd-e8ff-4763-84dd-c818756d9459', 'volume_name': 'volume-5b674bdd-e8ff-4763-84dd-c818756d9459', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f316a15a-9017-4f88-8ccc-b140a91d1ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f316a15a-9017-4f88-8ccc-b140a91d1ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e3bd73-39eb-4700-9da6-c065ad221f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:04 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Volume 5b674bdd-e8ff-4763-84dd-c818756d9459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b674bdd-e8ff-4763-84dd-c818756d9459', 'volume_size': 1} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1577902506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b674bdd-e8ff-4763-84dd-c818756d9459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ead8d0e262b74a29b8f9c88ded6ebc45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:04Z,use_quota=True,user_id='08dcc997ac3f4eb59e60d7d521525335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32d13205-c33d-4426-98b4-7a5c094bbb5e),volume_type_id=32d13205-c33d-4426-98b4-7a5c094bbb5e)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Creating volume 5b674bdd-e8ff-4763-84dd-c818756d9459 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:04 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:04 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459 1073741824 Jul 07 18:10:04 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Acquiring lock "cinder-6498a3a6-7fbb-4581-b8cd-39469bd4b566-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Lock "cinder-6498a3a6-7fbb-4581-b8cd-39469bd4b566-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Acquiring lock "cinder-quobyte-6498a3a6-7fbb-4581-b8cd-39469bd4b566" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Lock "cinder-quobyte-6498a3a6-7fbb-4581-b8cd-39469bd4b566" acquired by "delete_volume" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0959ad73-b7af-46f9-8e29-5523f42d77ef]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:05 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 Jul 07 18:10:05 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:05 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459 1073741824" returned: 0 in 1.044s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:05 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459 Jul 07 18:10:05 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Flow 'volume_create_manager' (674ecbbb-3871-42f7-bd54-0e8668f8e91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d268cfd-c005-40a1-8887-7601e36652c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d268cfd-c005-40a1-8887-7601e36652c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1515370590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd980e76-82d2-4371-b8e4-f44d5b6546ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0175f8c019ad4d769d0af54c6370c873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:06Z,use_quota=True,user_id='3c22dc91fa6147ab98ff643fe434c2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c9391f-0b16-4145-9598-9d2a0e320cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c9391f-0b16-4145-9598-9d2a0e320cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1ba2a6-0892-49a2-9f5d-e3f798a1622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1ba2a6-0892-49a2-9f5d-e3f798a1622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd980e76-82d2-4371-b8e4-f44d5b6546ad', 'volume_name': 'volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31d2bff-d7fc-4380-b9ca-29ab2edb216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31d2bff-d7fc-4380-b9ca-29ab2edb216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a369344-5681-4459-bd11-f50e276ccbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:05 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Volume bd980e76-82d2-4371-b8e4-f44d5b6546ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad', 'volume_size': 1} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:05 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566" returned: 0 in 0.845s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:06 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 Jul 07 18:10:06 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:06 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459" returned: 0 in 0.652s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1515370590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd980e76-82d2-4371-b8e4-f44d5b6546ad,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0175f8c019ad4d769d0af54c6370c873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:06Z,use_quota=True,user_id='3c22dc91fa6147ab98ff643fe434c2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Creating volume bd980e76-82d2-4371-b8e4-f44d5b6546ad {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:06 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49e3bd73-39eb-4700-9da6-c065ad221f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b674bdd-e8ff-4763-84dd-c818756d9459', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:06 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad 1073741824 Jul 07 18:10:06 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75674d15-95f4-4d98-99a3-5c0636157b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Volume volume-5b674bdd-e8ff-4763-84dd-c818756d9459 (5b674bdd-e8ff-4763-84dd-c818756d9459): created successfully Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75674d15-95f4-4d98-99a3-5c0636157b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Flow 'volume_create_manager' (ad6c3218-3387-4df8-a0ee-fc7691851d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-073ec261-9e8d-4d91-ab5f-e1c39ee3e7e6 tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Created volume successfully. Jul 07 18:10:06 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566" returned: 1 in 0.930s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:06 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566 Jul 07 18:10:06 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4546e448-9fd2-4a0e-8a0e-6d265ecc0e3e tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4546e448-9fd2-4a0e-8a0e-6d265ecc0e3e tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4546e448-9fd2-4a0e-8a0e-6d265ecc0e3e tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4546e448-9fd2-4a0e-8a0e-6d265ecc0e3e tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4546e448-9fd2-4a0e-8a0e-6d265ecc0e3e tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4546e448-9fd2-4a0e-8a0e-6d265ecc0e3e tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:06 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:10:06 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:07 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad 1073741824" returned: 0 in 0.948s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:07 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad Jul 07 18:10:07 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:07 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6498a3a6-7fbb-4581-b8cd-39469bd4b566" returned: 0 in 0.698s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Lock "cinder-quobyte-6498a3a6-7fbb-4581-b8cd-39469bd4b566" released by "delete_volume" :: held 2.546s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Created reservations ['750505d6-bf2b-4202-8f17-bca8d075fa34', 'b173c6bd-6f78-4e83-a307-f297d6a33ec0', '126677b8-7cf5-4fb6-91e6-0a309d96e4fe', '1cf5d6d6-6e4c-4d2b-a207-10728c6726ea'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:10:07 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4546e448-9fd2-4a0e-8a0e-6d265ecc0e3e tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.701s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-4546e448-9fd2-4a0e-8a0e-6d265ecc0e3e tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4546e448-9fd2-4a0e-8a0e-6d265ecc0e3e tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Retype volume completed successfully. Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:07 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:10:07 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:07 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad" returned: 0 in 0.691s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a369344-5681-4459-bd11-f50e276ccbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf2a67e-b99c-445e-948b-28fbf6b2ccf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:07 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Volume volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad (bd980e76-82d2-4371-b8e4-f44d5b6546ad): created successfully Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaf2a67e-b99c-445e-948b-28fbf6b2ccf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Flow 'volume_create_manager' (674ecbbb-3871-42f7-bd54-0e8668f8e91e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-36792d14-8942-4d1b-a567-d71537a0ab0d tempest-VolumesListTestJSON-1636981759 None] Created volume successfully. Jul 07 18:10:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Acquiring lock "cinder-5b674bdd-e8ff-4763-84dd-c818756d9459-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "cinder-5b674bdd-e8ff-4763-84dd-c818756d9459-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Acquiring lock "cinder-quobyte-5b674bdd-e8ff-4763-84dd-c818756d9459" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "cinder-quobyte-5b674bdd-e8ff-4763-84dd-c818756d9459" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a4af2f-5647-4279-96d0-9cafca3230bc]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:08 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459 Jul 07 18:10:08 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:08 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.714s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:08 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Deleted volume successfully. Jul 07 18:10:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ed50c5f0-38e7-4fb5-a4b3-d7cd96ba4d7f tempest-VolumesImageMetadata-685135844 None] Lock "cinder-6498a3a6-7fbb-4581-b8cd-39469bd4b566-delete_volume" released by "delete_volume" :: held 3.498s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:09 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459" returned: 0 in 0.954s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:09 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459 Jul 07 18:10:09 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Flow 'volume_create_manager' (bb54886d-ea80-4041-a695-b2597bf106c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefb49c4-fd79-4be0-b950-e46ec8136e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fefb49c4-fd79-4be0-b950-e46ec8136e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1076304798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907cda3b-aa15-4a55-84ec-e2c2bd67e71d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0175f8c019ad4d769d0af54c6370c873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:10Z,use_quota=True,user_id='3c22dc91fa6147ab98ff643fe434c2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea1e58f-bbd2-408c-b295-2b2200af197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea1e58f-bbd2-408c-b295-2b2200af197c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817ddb9f-82f0-4635-baa0-37539b9526e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (817ddb9f-82f0-4635-baa0-37539b9526e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907cda3b-aa15-4a55-84ec-e2c2bd67e71d', 'volume_name': 'volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c9966e-a8db-4fb6-a883-4185d53871dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c9966e-a8db-4fb6-a883-4185d53871dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6688fdc-e85e-4e87-bcc5-156ab1af1297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:09 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Volume 907cda3b-aa15-4a55-84ec-e2c2bd67e71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d', 'volume_size': 1} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1076304798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=907cda3b-aa15-4a55-84ec-e2c2bd67e71d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0175f8c019ad4d769d0af54c6370c873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:10Z,use_quota=True,user_id='3c22dc91fa6147ab98ff643fe434c2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Creating volume 907cda3b-aa15-4a55-84ec-e2c2bd67e71d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:09 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:09 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d 1073741824 Jul 07 18:10:09 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:09 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5b674bdd-e8ff-4763-84dd-c818756d9459" returned: 0 in 0.771s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "cinder-quobyte-5b674bdd-e8ff-4763-84dd-c818756d9459" released by "delete_volume" :: held 1.779s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:10 devstack cinder-volume[86972]: WARNING cinder.quota [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:10:10 devstack cinder-volume[86972]: WARNING cinder.quota [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Created reservations ['bd85dadd-5b3e-407e-8802-0ace07ad65da', 'c959540c-188e-4c58-8d29-aa159217630e', '6c2d32d4-1962-4c78-900d-8a90df065ed2', '7588f66b-3522-4bf0-a5d0-2f30020c6756'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:10 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:10:10 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:10 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d 1073741824" returned: 0 in 1.132s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:10 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d Jul 07 18:10:10 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:11 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.932s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Deleted volume successfully. Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0fa020c9-35c7-4ebe-bb2e-3c01160fc91f tempest-VolumeRetypeWithoutMigrationTest-1653033710 None] Lock "cinder-5b674bdd-e8ff-4763-84dd-c818756d9459-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:11 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d" returned: 0 in 0.806s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6688fdc-e85e-4e87-bcc5-156ab1af1297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6369339-2f4a-4006-bc17-07db6910fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:11 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Volume volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d (907cda3b-aa15-4a55-84ec-e2c2bd67e71d): created successfully Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6369339-2f4a-4006-bc17-07db6910fae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Flow 'volume_create_manager' (bb54886d-ea80-4041-a695-b2597bf106c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-bc4ebacc-6c7f-4069-9b44-f6a1de6b542e tempest-VolumesListTestJSON-1636981759 None] Created volume successfully. Jul 07 18:10:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:10:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:12 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:10:12 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Flow 'volume_create_manager' (aa0947fb-4260-4948-85cd-406c9e49da59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d3158f-a77a-4444-ab24-2b3dc1564d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d3158f-a77a-4444-ab24-2b3dc1564d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-601934230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a16ec4-5235-4cdf-b7c0-231b98a0099b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0175f8c019ad4d769d0af54c6370c873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:13Z,use_quota=True,user_id='3c22dc91fa6147ab98ff643fe434c2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84044f84-cd81-4759-95bc-7f47cf0cecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84044f84-cd81-4759-95bc-7f47cf0cecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08441b1-9fca-4b02-9afd-2eb3a90bdcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08441b1-9fca-4b02-9afd-2eb3a90bdcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a16ec4-5235-4cdf-b7c0-231b98a0099b', 'volume_name': 'volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0718cad5-c573-45a7-8c01-1c67bede21f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0718cad5-c573-45a7-8c01-1c67bede21f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cab156e-025d-47bc-aba2-1c6e18a9ac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:13 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Volume 05a16ec4-5235-4cdf-b7c0-231b98a0099b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b', 'volume_size': 1} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-601934230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a16ec4-5235-4cdf-b7c0-231b98a0099b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0175f8c019ad4d769d0af54c6370c873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:13Z,use_quota=True,user_id='3c22dc91fa6147ab98ff643fe434c2d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Creating volume 05a16ec4-5235-4cdf-b7c0-231b98a0099b {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:13 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:13 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.848s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:10:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:10:13 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b 1073741824 Jul 07 18:10:13 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:14 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b 1073741824" returned: 0 in 0.991s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:14 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b Jul 07 18:10:14 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:14 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Flow 'volume_create_manager' (dfa20eb5-7e96-4834-95ca-d68fdf9297c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8078e25-0bd8-4ea3-9588-b268d5704c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8078e25-0bd8-4ea3-9588-b268d5704c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1941365938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e777206-1b87-466c-99ec-84f4bad8f52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142855e2f6e14d259beafefc0af83c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:15Z,use_quota=True,user_id='94ee531187534fd2a9fcc5986d4b9e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb540f92-51d9-413a-bb29-3c2b7da03ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb540f92-51d9-413a-bb29-3c2b7da03ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8434857f-f395-428f-a0f2-0b88aefe6071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8434857f-f395-428f-a0f2-0b88aefe6071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e777206-1b87-466c-99ec-84f4bad8f52f', 'volume_name': 'volume-6e777206-1b87-466c-99ec-84f4bad8f52f', 'volume_size': 2}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e3b645-a973-4b1c-8f0b-f99fca9d46f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60e3b645-a973-4b1c-8f0b-f99fca9d46f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5298b39-235e-40cc-bf54-b5fcc50c2dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:15 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Volume 6e777206-1b87-466c-99ec-84f4bad8f52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e777206-1b87-466c-99ec-84f4bad8f52f', 'volume_size': 2} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:15 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b" returned: 0 in 0.716s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1941365938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e777206-1b87-466c-99ec-84f4bad8f52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142855e2f6e14d259beafefc0af83c66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:15Z,use_quota=True,user_id='94ee531187534fd2a9fcc5986d4b9e2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Creating volume 6e777206-1b87-466c-99ec-84f4bad8f52f {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:15 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f 2147483648 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:15 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f 2147483648 Jul 07 18:10:15 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cab156e-025d-47bc-aba2-1c6e18a9ac10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b0e53b-82cc-4fd3-a464-1d454ed95826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:15 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Volume volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b (05a16ec4-5235-4cdf-b7c0-231b98a0099b): created successfully Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b0e53b-82cc-4fd3-a464-1d454ed95826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Flow 'volume_create_manager' (aa0947fb-4260-4948-85cd-406c9e49da59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a829ccf2-7a8c-4203-a8dc-e2b4b76deb71 tempest-VolumesListTestJSON-1636981759 None] Created volume successfully. Jul 07 18:10:16 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f 2147483648" returned: 0 in 0.985s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:16 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f Jul 07 18:10:16 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Flow 'volume_create_manager' (5383ae5c-7d67-4c4c-84ec-e683578adb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6564c6de-b068-4749-bf63-31dc45a0e530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6564c6de-b068-4749-bf63-31dc45a0e530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1986685729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b8ea49-49ab-413e-998e-7ae40cc8a74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c314efd9bb4e909f6abdfbb7464fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:17Z,use_quota=True,user_id='2bb37ac1a62e43d6a38a83cb1b3c6cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cf0b2f-8e53-4b08-b15a-9c2a9354979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8cf0b2f-8e53-4b08-b15a-9c2a9354979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4a2931-bcf9-4662-a30b-293126b1e0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4a2931-bcf9-4662-a30b-293126b1e0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b8ea49-49ab-413e-998e-7ae40cc8a74f', 'volume_name': 'volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3600b9ef-e396-4d06-bc29-1bb4290d89ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3600b9ef-e396-4d06-bc29-1bb4290d89ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccba89e8-d2e6-4193-b068-d0e06e7262d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:17 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Volume d6b8ea49-49ab-413e-998e-7ae40cc8a74f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f', 'volume_size': 1} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:17 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f" returned: 0 in 0.809s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.084s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1986685729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6b8ea49-49ab-413e-998e-7ae40cc8a74f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c314efd9bb4e909f6abdfbb7464fb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:17Z,use_quota=True,user_id='2bb37ac1a62e43d6a38a83cb1b3c6cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Creating volume d6b8ea49-49ab-413e-998e-7ae40cc8a74f {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:17 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:17 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f 1073741824 Jul 07 18:10:17 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5298b39-235e-40cc-bf54-b5fcc50c2dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e777206-1b87-466c-99ec-84f4bad8f52f', 'volume_size': 2}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea540abd-9823-4441-831a-239022f84677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:17 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Volume volume-6e777206-1b87-466c-99ec-84f4bad8f52f (6e777206-1b87-466c-99ec-84f4bad8f52f): created successfully Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea540abd-9823-4441-831a-239022f84677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Flow 'volume_create_manager' (dfa20eb5-7e96-4834-95ca-d68fdf9297c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-602efd20-34d9-4a15-9f0b-bd32d09b0754 tempest-VolumesCloneNegativeTest-1797190095 None] Created volume successfully. Jul 07 18:10:18 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f 1073741824" returned: 0 in 0.911s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:18 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f Jul 07 18:10:18 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Acquiring lock "cinder-6e777206-1b87-466c-99ec-84f4bad8f52f-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "cinder-6e777206-1b87-466c-99ec-84f4bad8f52f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Acquiring lock "cinder-quobyte-6e777206-1b87-466c-99ec-84f4bad8f52f" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "cinder-quobyte-6e777206-1b87-466c-99ec-84f4bad8f52f" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:18 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1cd6a2-5c02-438b-95a4-1c380480b897]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:18 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f Jul 07 18:10:18 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:19 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" returned: 0 in 0.768s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "cinder-05a16ec4-5235-4cdf-b7c0-231b98a0099b-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccba89e8-d2e6-4193-b068-d0e06e7262d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cf099d-26b2-4da3-a16a-3229047e74fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-05a16ec4-5235-4cdf-b7c0-231b98a0099b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:19 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Volume volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f (d6b8ea49-49ab-413e-998e-7ae40cc8a74f): created successfully Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47cf099d-26b2-4da3-a16a-3229047e74fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Flow 'volume_create_manager' (5383ae5c-7d67-4c4c-84ec-e683578adb0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-eb86f1d0-b3c2-49fd-b712-3482abbae8d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Created volume successfully. Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "cinder-quobyte-05a16ec4-5235-4cdf-b7c0-231b98a0099b" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-quobyte-05a16ec4-5235-4cdf-b7c0-231b98a0099b" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee78806-2e35-4b63-b237-ef9193c3838f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:19 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b Jul 07 18:10:19 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:19 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f" returned: 0 in 0.849s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:19 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f Jul 07 18:10:19 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:19 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b" returned: 0 in 0.820s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:20 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b Jul 07 18:10:20 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:20 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e777206-1b87-466c-99ec-84f4bad8f52f" returned: 0 in 0.739s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "cinder-quobyte-6e777206-1b87-466c-99ec-84f4bad8f52f" released by "delete_volume" :: held 1.662s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Created reservations ['206171d7-7f57-4dae-9be8-6c9ed4fa4128', '58a246d9-f83b-469a-a074-438ef39d780f', '065254b3-d47a-4990-8f4c-32b9b24d19e2', '0f79a024-5502-42db-ae6c-e5a5e278b367'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:20 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:10:20 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Creating offline snapshot c6253d18-86ce-4f73-8a0e-25ed23f5fa25 of volume d6b8ea49-49ab-413e-998e-7ae40cc8a74f {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0831be3-b4a9-4604-8136-dcff1c274742]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:20 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f Jul 07 18:10:20 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:20 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-05a16ec4-5235-4cdf-b7c0-231b98a0099b" returned: 0 in 0.968s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-quobyte-05a16ec4-5235-4cdf-b7c0-231b98a0099b" released by "delete_volume" :: held 1.831s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Created reservations ['817fc42d-f49c-4588-859e-3fd27cfe1db0', '51e9e008-7ca9-4680-b153-e8d2c8c20907', '9857e144-7985-480a-a9ac-40babe0f8847', 'e26b233e-b3c4-4f45-9e5e-fdfdf543bb4c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:21 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:10:21 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:21 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.875s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:21 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Deleted volume successfully. Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-25ad14e1-0e40-4d0c-9967-88f85090eb72 tempest-VolumesCloneNegativeTest-1797190095 None] Lock "cinder-6e777206-1b87-466c-99ec-84f4bad8f52f-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "cinder-907cda3b-aa15-4a55-84ec-e2c2bd67e71d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-907cda3b-aa15-4a55-84ec-e2c2bd67e71d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "cinder-quobyte-907cda3b-aa15-4a55-84ec-e2c2bd67e71d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-quobyte-907cda3b-aa15-4a55-84ec-e2c2bd67e71d" acquired by "delete_volume" :: waited 0.034s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:21 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" returned: 0 in 1.043s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb709af-5e6d-4a14-8916-84d108a30739]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:21 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 1G Jul 07 18:10:21 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:21 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d Jul 07 18:10:21 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:22 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.943s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:22 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:22 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Deleted volume successfully. Jul 07 18:10:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-391fe029-0305-4a29-a220-fcba94ed4476 tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-05a16ec4-5235-4cdf-b7c0-231b98a0099b-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:22 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d" returned: 0 in 0.978s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:22 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d Jul 07 18:10:22 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:22 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 1G" returned: 0 in 1.065s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:22 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 Jul 07 18:10:22 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:23 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-907cda3b-aa15-4a55-84ec-e2c2bd67e71d" returned: 0 in 0.743s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-quobyte-907cda3b-aa15-4a55-84ec-e2c2bd67e71d" released by "delete_volume" :: held 1.786s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:23 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25" returned: 0 in 0.738s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:23 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 is being set with open permissions: ugo+rw Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Created reservations ['cc103a02-0ab1-4589-aa97-07257af7bd2a', '2968c73b-0e3b-4661-a021-77c3169dd278', 'b4334076-b8a7-4f39-ac65-0eca31686d3e', 'bd0f66a5-a97a-4a56-8ab7-cd28cbfc824e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:10:23 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 Jul 07 18:10:23 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:23 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:10:23 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "cinder-bd980e76-82d2-4371-b8e4-f44d5b6546ad-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-bd980e76-82d2-4371-b8e4-f44d5b6546ad-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "cinder-quobyte-bd980e76-82d2-4371-b8e4-f44d5b6546ad" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-quobyte-bd980e76-82d2-4371-b8e4-f44d5b6546ad" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ebe335-a13e-4559-bfcd-cbdb4376010a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:24 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad Jul 07 18:10:24 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:24 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25" returned: 0 in 0.807s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:24 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.info Jul 07 18:10:24 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:24 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.905s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Deleted volume successfully. Jul 07 18:10:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3e70b18-4140-4537-9923-560183b8228b tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-907cda3b-aa15-4a55-84ec-e2c2bd67e71d-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:25 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad" returned: 0 in 0.951s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:25 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.info" returned: 0 in 0.794s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:25 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.info is being set with open permissions: ugo+rw Jul 07 18:10:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:25 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad Jul 07 18:10:25 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:25 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.info Jul 07 18:10:25 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:25 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.info" returned: 0 in 0.694s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:25 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.277s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bd980e76-82d2-4371-b8e4-f44d5b6546ad" returned: 0 in 0.766s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-quobyte-bd980e76-82d2-4371-b8e4-f44d5b6546ad" released by "delete_volume" :: held 1.771s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:25 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-76ad900c-6638-4337-a168-e807c2e48956 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Create snapshot completed successfully Jul 07 18:10:25 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Created reservations ['13a99eac-b70d-41b9-9061-38cf57ec5065', 'd7b25a59-a176-46bb-b5b6-5f7f978baa5e', '474a421b-83c9-4935-9853-624a7c4d19a9', 'b5217998-0a73-432b-af5c-a87eff83ed9f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:10:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:26 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:10:26 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:26 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.783s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:26 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Deleted volume successfully. Jul 07 18:10:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8e29586d-b2bf-4879-a439-046b90eaa47d tempest-VolumesListTestJSON-1636981759 None] Lock "cinder-bd980e76-82d2-4371-b8e4-f44d5b6546ad-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Acquiring lock "cinder-c6253d18-86ce-4f73-8a0e-25ed23f5fa25-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-c6253d18-86ce-4f73-8a0e-25ed23f5fa25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Acquiring lock "cinder-quobyte-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-quobyte-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Acquiring lock "cinder-quobyte-c6253d18-86ce-4f73-8a0e-25ed23f5fa25" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-quobyte-c6253d18-86ce-4f73-8a0e-25ed23f5fa25" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Deleting offline snapshot c6253d18-86ce-4f73-8a0e-25ed23f5fa25 of volume d6b8ea49-49ab-413e-998e-7ae40cc8a74f {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] snapshot_file for this snap is: volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ad0dad-8d9f-4b8f-961f-19cc805cae4d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:27 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 Jul 07 18:10:27 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:28 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25" returned: 0 in 0.873s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:10:28 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb3f65f-07de-4b27-8f41-e23bb23032d9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:28 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f Jul 07 18:10:28 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:29 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" returned: 0 in 0.917s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:29 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 Jul 07 18:10:29 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:30 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25" returned: 0 in 0.921s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:30 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25 Jul 07 18:10:30 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:31 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f.c6253d18-86ce-4f73-8a0e-25ed23f5fa25" returned: 0 in 0.797s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-quobyte-c6253d18-86ce-4f73-8a0e-25ed23f5fa25" released by "_delete_snapshot" :: held 3.642s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-quobyte-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" released by "delete_snapshot" :: held 3.672s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Created reservations ['80585f14-ccfb-4c50-bf16-e46aa581de13', '5f17f6bd-dafa-4d4e-884c-96bea51510cf', '77f8414b-e37e-4531-9de7-5561b5a04e4a', 'f7fad104-cbfd-4b0f-8a71-233e824a730d'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:10:31 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Delete snapshot completed successfully. Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5c4fd1ab-005d-4ab6-9f25-9216a4889249 tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-c6253d18-86ce-4f73-8a0e-25ed23f5fa25-delete_snapshot" released by "delete_snapshot" :: held 3.853s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Acquiring lock "cinder-d6b8ea49-49ab-413e-998e-7ae40cc8a74f-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-d6b8ea49-49ab-413e-998e-7ae40cc8a74f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Acquiring lock "cinder-quobyte-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-quobyte-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[678db70b-b5ee-42d4-a907-e90585042336]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:32 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f Jul 07 18:10:32 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:32 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" returned: 0 in 0.891s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:32 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f Jul 07 18:10:32 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:33 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" returned: 0 in 0.776s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-quobyte-d6b8ea49-49ab-413e-998e-7ae40cc8a74f" released by "delete_volume" :: held 1.744s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:33 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Created reservations ['0aac1687-e853-4d77-b6a5-941d81552b37', '8e610ead-36cf-40b1-8c74-f90944c4a0ba', '3857c65c-8835-4ecb-b4c5-945dfaa94064', '32bf8a69-33ca-4a3a-8b31-7b4ad79ca426'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:10:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:33 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:10:33 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:34 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.828s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:34 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:10:34 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Deleted volume successfully. Jul 07 18:10:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4eb21db5-9965-4f58-a0a5-0f68bdbeb33b tempest-VolumeSnapshotQuotasNegativeTestJSON-831794472 None] Lock "cinder-d6b8ea49-49ab-413e-998e-7ae40cc8a74f-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:40 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=130,cinder:UPDATE=169,cinder:INSERT=53,cinder:DELETE=14 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:10:40 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:INSERT=40,cinder:UPDATE=176,cinder:SELECT=125,cinder:DELETE=13 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:10:40 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:10:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (f73b97b1-d180-43f4-8821-f3e3309d5ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952bd6c1-7230-444e-a474-d151f3b11675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952bd6c1-7230-444e-a474-d151f3b11675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-627010430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412a8af6-1ac8-481e-a7b2-23bab42d8e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee24897d279428cb9cdd72cf34b0063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:41Z,use_quota=True,user_id='8b38eb2fc5bc4310b9aff408f82013db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05757db8-17a7-4745-92c2-845d4c3ca1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05757db8-17a7-4745-92c2-845d4c3ca1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5060b91-5b60-48cd-bb78-84e69dc27abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5060b91-5b60-48cd-bb78-84e69dc27abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412a8af6-1ac8-481e-a7b2-23bab42d8e89', 'volume_name': 'volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07676c9-7590-4561-8064-044df221d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07676c9-7590-4561-8064-044df221d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fd35e8-4a9d-40e4-ad92-8a236159b3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:41 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Volume 412a8af6-1ac8-481e-a7b2-23bab42d8e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89', 'volume_size': 1} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-627010430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412a8af6-1ac8-481e-a7b2-23bab42d8e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee24897d279428cb9cdd72cf34b0063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:41Z,use_quota=True,user_id='8b38eb2fc5bc4310b9aff408f82013db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Creating volume 412a8af6-1ac8-481e-a7b2-23bab42d8e89 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:41 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:10:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:41 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 1073741824 Jul 07 18:10:41 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:42 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 1073741824" returned: 0 in 1.004s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:42 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 Jul 07 18:10:42 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:42 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89" returned: 0 in 0.785s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fd35e8-4a9d-40e4-ad92-8a236159b3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a035e0-2ea4-4839-8cf0-8c924a734139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:42 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Volume volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 (412a8af6-1ac8-481e-a7b2-23bab42d8e89): created successfully Jul 07 18:10:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a035e0-2ea4-4839-8cf0-8c924a734139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (f73b97b1-d180-43f4-8821-f3e3309d5ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:43 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9dfaf824-6805-42c2-893e-1025ab569ce7 tempest-VolumesSnapshotTestJSON-1728726872 None] Created volume successfully. Jul 07 18:10:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Creating offline snapshot cdd23336-3736-4e3e-bead-c4da419ca19c of volume 412a8af6-1ac8-481e-a7b2-23bab42d8e89 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:10:44 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b3ae34-41f8-489f-b97d-3a0ad3d5a846]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:44 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 Jul 07 18:10:44 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:45 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89" returned: 0 in 0.832s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:45 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c 1G Jul 07 18:10:45 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:46 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c 1G" returned: 0 in 0.951s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:46 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c Jul 07 18:10:46 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:47 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c" returned: 0 in 0.776s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:47 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c is being set with open permissions: ugo+rw Jul 07 18:10:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:47 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c Jul 07 18:10:47 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:47 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c" returned: 0 in 0.759s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:48 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.info Jul 07 18:10:48 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:48 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.info" returned: 0 in 0.879s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:48 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.info is being set with open permissions: ugo+rw Jul 07 18:10:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:48 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.info Jul 07 18:10:48 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:49 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.info" returned: 0 in 0.735s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.141s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:49 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1aa984ad-72b1-4306-9949-77d8af485aee tempest-VolumesSnapshotTestJSON-1728726872 None] Create snapshot completed successfully Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-cdd23336-3736-4e3e-bead-c4da419ca19c-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-cdd23336-3736-4e3e-bead-c4da419ca19c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-412a8af6-1ac8-481e-a7b2-23bab42d8e89" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-412a8af6-1ac8-481e-a7b2-23bab42d8e89" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-cdd23336-3736-4e3e-bead-c4da419ca19c" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-cdd23336-3736-4e3e-bead-c4da419ca19c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Deleting offline snapshot cdd23336-3736-4e3e-bead-c4da419ca19c of volume 412a8af6-1ac8-481e-a7b2-23bab42d8e89 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] snapshot_file for this snap is: volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67fe521-0ef5-4ff4-9a09-e3c79bc8fccb]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:51 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c Jul 07 18:10:51 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:52 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c" returned: 0 in 0.889s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:10:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c23a93a-cee0-4d0c-af73-d146f30aee4b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:52 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 Jul 07 18:10:52 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:53 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89" returned: 0 in 0.953s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:53 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c Jul 07 18:10:53 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Flow 'volume_create_manager' (ff4289cf-76c4-4c1d-8a95-0b3be7bd037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4fdafb-063b-488c-bf96-d7c02ebb2086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4fdafb-063b-488c-bf96-d7c02ebb2086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2088334724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f6476c-adbd-4332-9874-e0062af4a7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d633e9da5e9482aaf303e8726a6e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:54Z,use_quota=True,user_id='274a117907a341ca9ac19658e0c4fe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399b6a15-4cac-49d6-8b4d-519495fd9030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399b6a15-4cac-49d6-8b4d-519495fd9030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59aaf6c2-17e9-4c46-b5f5-17d8aef26459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59aaf6c2-17e9-4c46-b5f5-17d8aef26459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f6476c-adbd-4332-9874-e0062af4a7b4', 'volume_name': 'volume-41f6476c-adbd-4332-9874-e0062af4a7b4', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a05fe75-ffea-4777-ada3-3c0bef4d2440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a05fe75-ffea-4777-ada3-3c0bef4d2440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58965ffc-8145-4317-bbc1-bebed6bfe30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Volume 41f6476c-adbd-4332-9874-e0062af4a7b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f6476c-adbd-4332-9874-e0062af4a7b4', 'volume_size': 1} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2088334724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f6476c-adbd-4332-9874-e0062af4a7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d633e9da5e9482aaf303e8726a6e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:54Z,use_quota=True,user_id='274a117907a341ca9ac19658e0c4fe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Creating volume 41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:53 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:10:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:53 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 1073741824 Jul 07 18:10:53 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:54 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c" returned: 0 in 0.981s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:54 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c Jul 07 18:10:54 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:54 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89.cdd23336-3736-4e3e-bead-c4da419ca19c" returned: 0 in 0.891s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-cdd23336-3736-4e3e-bead-c4da419ca19c" released by "_delete_snapshot" :: held 3.855s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-412a8af6-1ac8-481e-a7b2-23bab42d8e89" released by "delete_snapshot" :: held 3.892s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:55 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Created reservations ['01a01dd0-ed39-406e-9f63-47904c73bab9', '982bdcbb-c50a-4644-8e7c-50f4c18c173b', '225feb56-d97f-45b7-b01a-0c3d5806ac5f', 'cc568789-fc82-4928-bab9-8b7afd0c47ae'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:10:55 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 1073741824" returned: 0 in 1.300s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:55 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Delete snapshot completed successfully. Jul 07 18:10:55 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 Jul 07 18:10:55 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c984ca03-765a-43e3-970c-ab93ed97b0b8 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-cdd23336-3736-4e3e-bead-c4da419ca19c-delete_snapshot" released by "delete_snapshot" :: held 4.158s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:10:56 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (b292efed-1199-4544-b7ee-a024079bb37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7ff934-7296-4930-a1ff-d7d06f9e88f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4" returned: 0 in 1.269s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] <== create_volume: return (2622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.625s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7ff934-7296-4930-a1ff-d7d06f9e88f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-19938012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee24897d279428cb9cdd72cf34b0063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:56Z,use_quota=True,user_id='8b38eb2fc5bc4310b9aff408f82013db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9ef372-a748-4c80-bdbe-44e7092d5f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9ef372-a748-4c80-bdbe-44e7092d5f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e7ce8e-216d-4dff-bac7-c00a8d101200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e7ce8e-216d-4dff-bac7-c00a8d101200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b', 'volume_name': 'volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4e57c1-9c6b-4028-ab11-af1dbff2e124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4e57c1-9c6b-4028-ab11-af1dbff2e124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e09013-dc2d-483d-a865-44b38b135d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:56 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Volume 00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b', 'volume_size': 1} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-19938012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee24897d279428cb9cdd72cf34b0063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:10:56Z,use_quota=True,user_id='8b38eb2fc5bc4310b9aff408f82013db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Creating volume 00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:10:56 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58965ffc-8145-4317-bbc1-bebed6bfe30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f6476c-adbd-4332-9874-e0062af4a7b4', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6b79e8-59c8-46ef-b8c6-06aa70ef0ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:56 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b 1073741824 Jul 07 18:10:56 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:56 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Volume volume-41f6476c-adbd-4332-9874-e0062af4a7b4 (41f6476c-adbd-4332-9874-e0062af4a7b4): created successfully Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a6b79e8-59c8-46ef-b8c6-06aa70ef0ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Flow 'volume_create_manager' (ff4289cf-76c4-4c1d-8a95-0b3be7bd037d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:56 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c3663605-b722-4d5c-895b-020e8188470e tempest-TestStampPattern-891121631 None] Created volume successfully. Jul 07 18:10:57 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b 1073741824" returned: 0 in 1.308s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:57 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b Jul 07 18:10:57 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:10:58 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jul 07 18:10:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" returned: 0 in 0.802s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:10:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:10:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.179s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:10:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e09013-dc2d-483d-a865-44b38b135d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912a8727-a8b0-4cff-994c-cbe1a9e0f32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:10:58 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Volume volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b (00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b): created successfully Jul 07 18:10:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912a8727-a8b0-4cff-994c-cbe1a9e0f32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:10:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (b292efed-1199-4544-b7ee-a024079bb37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:10:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-65fa4d0e-193c-44b1-bf6e-94f52cb84fdc tempest-VolumesSnapshotTestJSON-1728726872 None] Created volume successfully. Jul 07 18:10:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:10:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:10:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Creating offline snapshot d950979f-41d5-41ac-8097-f011b8861d37 of volume 00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:10:59 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[010cc074-dca4-4f12-881a-d20f1b74e000]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:10:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:10:59 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b Jul 07 18:10:59 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:00 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" returned: 0 in 0.844s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:00 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 1G Jul 07 18:11:00 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:01 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 1G" returned: 0 in 0.887s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:01 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 Jul 07 18:11:01 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:02 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37" returned: 0 in 0.781s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:02 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 is being set with open permissions: ugo+rw Jul 07 18:11:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:02 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 Jul 07 18:11:02 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:03 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37" returned: 0 in 0.970s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:03 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.info Jul 07 18:11:03 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:03 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.info" returned: 0 in 0.812s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:03 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.info is being set with open permissions: ugo+rw Jul 07 18:11:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:03 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.info Jul 07 18:11:03 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:04 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.info" returned: 0 in 0.795s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.248s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1bcb0fe8-57ca-4ae4-a0cf-c4bf113315a6 tempest-VolumesSnapshotTestJSON-1728726872 None] Create snapshot completed successfully Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (29cb9dfa-c0f2-476d-b836-7760d42401df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d829a0-2b4d-4916-81c6-bdcbf4075d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d829a0-2b4d-4916-81c6-bdcbf4075d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-948423394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a491355d-77f4-4029-9373-903d3a26bfef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee24897d279428cb9cdd72cf34b0063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d950979f-41d5-41ac-8097-f011b8861d37,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:07Z,use_quota=True,user_id='8b38eb2fc5bc4310b9aff408f82013db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d891eb53-744f-45a6-a1e2-8fd7c61a519a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d891eb53-744f-45a6-a1e2-8fd7c61a519a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdb440e-1021-4a2f-a0ee-899128b9bb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cdb440e-1021-4a2f-a0ee-899128b9bb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a491355d-77f4-4029-9373-903d3a26bfef', 'volume_name': 'volume-a491355d-77f4-4029-9373-903d3a26bfef', 'volume_size': 2, 'snapshot_id': 'd950979f-41d5-41ac-8097-f011b8861d37'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7089649f-6612-4c76-ac25-2a20d0eb693c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7089649f-6612-4c76-ac25-2a20d0eb693c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7f69f4-0698-40f5-93da-1ce8bc838209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Volume a491355d-77f4-4029-9373-903d3a26bfef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a491355d-77f4-4029-9373-903d3a26bfef', 'volume_size': 2, 'snapshot_id': 'd950979f-41d5-41ac-8097-f011b8861d37'} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-d950979f-41d5-41ac-8097-f011b8861d37-a491355d-77f4-4029-9373-903d3a26bfef" by "_create_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-d950979f-41d5-41ac-8097-f011b8861d37-a491355d-77f4-4029-9373-903d3a26bfef" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Creating volume a491355d-77f4-4029-9373-903d3a26bfef from snapshot d950979f-41d5-41ac-8097-f011b8861d37 {{(pid=86972) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-a491355d-77f4-4029-9373-903d3a26bfef" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-a491355d-77f4-4029-9373-903d3a26bfef" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] snapshot: d950979f-41d5-41ac-8097-f011b8861d37, volume: a491355d-77f4-4029-9373-903d3a26bfef, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6f0870-eff4-40e3-8d07-7f10033cc2ea]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:07 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 Jul 07 18:11:07 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:07 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37" returned: 0 in 0.947s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:11:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:11:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:11:07 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ababb649-9061-4e08-ba27-847d2eefd89b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:08 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b Jul 07 18:11:08 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:08 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" returned: 0 in 1.023s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:08 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:11:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:08 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef Jul 07 18:11:08 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:11:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:12 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:11:12 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:14 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 2.135s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:15 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:11:15 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:11:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:11:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:11:16 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef" returned: 0 in 7.557s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:16 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7f43a4-0f4e-4c12-9300-3302a0607356]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:16 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:11:16 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b Jul 07 18:11:16 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:16 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:11:18 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" returned: 0 in 1.532s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:18 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:11:18 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Converted 1024.00 MB image at 135.48 MB/s Jul 07 18:11:18 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef is being set with open permissions: ugo+rw Jul 07 18:11:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:18 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef Jul 07 18:11:18 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:18 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef" returned: 0 in 0.913s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-a491355d-77f4-4029-9373-903d3a26bfef" released by "_copy_volume_from_snapshot" :: held 12.133s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-d950979f-41d5-41ac-8097-f011b8861d37-a491355d-77f4-4029-9373-903d3a26bfef" released by "_create_volume_from_snapshot" :: held 12.181s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.209s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7f69f4-0698-40f5-93da-1ce8bc838209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a491355d-77f4-4029-9373-903d3a26bfef', 'volume_size': 2, 'snapshot_id': 'd950979f-41d5-41ac-8097-f011b8861d37'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87794e4-d25f-4c8e-a76b-48d90c693923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:19 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Volume volume-a491355d-77f4-4029-9373-903d3a26bfef (a491355d-77f4-4029-9373-903d3a26bfef): created successfully Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87794e4-d25f-4c8e-a76b-48d90c693923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (29cb9dfa-c0f2-476d-b836-7760d42401df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-061b522d-f8c7-4dcf-a0d1-2b5da1fac62f tempest-VolumesSnapshotTestJSON-1728726872 None] Created volume successfully. Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-a491355d-77f4-4029-9373-903d3a26bfef-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-a491355d-77f4-4029-9373-903d3a26bfef-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-a491355d-77f4-4029-9373-903d3a26bfef" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-a491355d-77f4-4029-9373-903d3a26bfef" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f70d35c-fcdc-41c4-baa4-5fc0850931fd]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:19 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef Jul 07 18:11:19 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:20 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef" returned: 0 in 1.062s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:20 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef Jul 07 18:11:20 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:21 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a491355d-77f4-4029-9373-903d3a26bfef" returned: 0 in 0.778s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-a491355d-77f4-4029-9373-903d3a26bfef" released by "delete_volume" :: held 1.889s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Created reservations ['4d966c47-31f1-428f-964d-25153e6ed854', 'e2c4e741-5363-4a97-ba04-2cd9b525a773', 'b6fd545a-760f-4a70-8859-4ea3f48e3913', 'f39a7af3-1594-454d-83ac-ecd4f37a3cec'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:21 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:11:21 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-d950979f-41d5-41ac-8097-f011b8861d37-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-d950979f-41d5-41ac-8097-f011b8861d37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-d950979f-41d5-41ac-8097-f011b8861d37" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-d950979f-41d5-41ac-8097-f011b8861d37" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Deleting offline snapshot d950979f-41d5-41ac-8097-f011b8861d37 of volume 00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:11:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] snapshot_file for this snap is: volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:11:22 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e50525e-f22b-4246-9fdb-cc4b52cdcf7c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:22 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 Jul 07 18:11:22 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:22 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.122s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:22 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:11:22 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Deleted volume successfully. Jul 07 18:11:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8df90362-bcb8-4f6e-9a62-baf0d6685275 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-a491355d-77f4-4029-9373-903d3a26bfef-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:23 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37" returned: 0 in 1.271s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:11:23 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e5d4ac-0313-471e-b331-6e63f7b6effe]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:23 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b Jul 07 18:11:23 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:24 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" returned: 0 in 0.876s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:24 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 Jul 07 18:11:24 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:25 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37" returned: 0 in 0.875s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:25 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37 Jul 07 18:11:25 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:25 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b.d950979f-41d5-41ac-8097-f011b8861d37" returned: 0 in 0.786s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-d950979f-41d5-41ac-8097-f011b8861d37" released by "_delete_snapshot" :: held 3.984s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" released by "delete_snapshot" :: held 4.028s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:26 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Created reservations ['6e2e259e-adf5-48d9-8e93-8a37b688bce9', '1202e3b1-0358-4091-b144-de19da8eda2d', 'c405584d-98ae-421c-a204-3b7abbf3c8a8', '7af87781-7eff-4395-a837-b2e119619865'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Delete snapshot completed successfully. Jul 07 18:11:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f66c3fbb-8d0a-4520-bc1d-c947f8ac1bcb tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-d950979f-41d5-41ac-8097-f011b8861d37-delete_snapshot" released by "delete_snapshot" :: held 4.306s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:26 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dbad51-a3c9-46c7-9820-f4253f9f3483]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:26 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b Jul 07 18:11:26 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:27 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" returned: 0 in 0.837s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:27 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b Jul 07 18:11:27 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (03bee00e-7d9a-4557-83da-996ee1e2d508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7f74e5-3272-41de-a26d-79382bd73da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7f74e5-3272-41de-a26d-79382bd73da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-956931897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e625bac-d4ce-4e11-bd0f-f488abd33e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:28Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142aad3d-1adf-4406-8cbe-6ff86bc7da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (142aad3d-1adf-4406-8cbe-6ff86bc7da61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dd764e-d8f1-460a-ad36-ee0fefedf274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99dd764e-d8f1-460a-ad36-ee0fefedf274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e625bac-d4ce-4e11-bd0f-f488abd33e00', 'volume_name': 'volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:28 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe76b41-a030-47c1-a743-9ded303d95b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe76b41-a030-47c1-a743-9ded303d95b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb65df5-42eb-4456-9018-0ddec35c8477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:28 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Volume 6e625bac-d4ce-4e11-bd0f-f488abd33e00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00', 'volume_size': 1} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-956931897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e625bac-d4ce-4e11-bd0f-f488abd33e00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:28Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Creating volume 6e625bac-d4ce-4e11-bd0f-f488abd33e00 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:11:28 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" returned: 0 in 0.903s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:28 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 1073741824 Jul 07 18:11:28 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b" released by "delete_volume" :: held 1.811s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Created reservations ['f856d2b5-aced-41d9-a4cb-2cdd33e31c77', '66aed8f8-b8e1-4393-970f-7836a4aeef48', '2d1ee067-59c3-4ddb-b3a0-9165f2783e08', '0d29dcf2-9453-4bb6-9042-963f5ff38f76'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:28 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:11:28 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:29 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.872s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:11:29 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Deleted volume successfully. Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d34531fc-a9b6-4b5c-8467-ffb449480934 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-00c6dd3d-c4c2-48a9-9a52-d4a9ddb0025b-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:29 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 1073741824" returned: 0 in 1.139s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:29 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 Jul 07 18:11:29 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (c3fbb381-cd3f-4475-ac10-89f6b0af0db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3819cdf3-c968-4cd1-a6a0-e4dbeddef317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3819cdf3-c968-4cd1-a6a0-e4dbeddef317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1269965712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee24897d279428cb9cdd72cf34b0063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:30Z,use_quota=True,user_id='8b38eb2fc5bc4310b9aff408f82013db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a7994b-8d11-483c-a178-c74dde1d2e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a7994b-8d11-483c-a178-c74dde1d2e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ae1707-67c6-4419-b812-a482b92df82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ae1707-67c6-4419-b812-a482b92df82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9', 'volume_name': 'volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5620c4f-3ec7-4ae0-98a0-f88fe6d89872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5620c4f-3ec7-4ae0-98a0-f88fe6d89872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb99bee6-94d2-47ec-abbe-3f331350ec36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:29 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Volume 971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9', 'volume_size': 1} Jul 07 18:11:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:30 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00" returned: 0 in 0.638s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1269965712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee24897d279428cb9cdd72cf34b0063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:30Z,use_quota=True,user_id='8b38eb2fc5bc4310b9aff408f82013db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Creating volume 971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:11:30 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:30 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 1073741824 Jul 07 18:11:30 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb65df5-42eb-4456-9018-0ddec35c8477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cedfdd-cedd-4473-a2ac-2718ec8387ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:30 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Volume volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 (6e625bac-d4ce-4e11-bd0f-f488abd33e00): created successfully Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cedfdd-cedd-4473-a2ac-2718ec8387ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (03bee00e-7d9a-4557-83da-996ee1e2d508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:30 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9cfc7ebd-5a74-49c5-8ea6-9bd67e60cda1 tempest-VolumesActionsTest-1352870404 None] Created volume successfully. Jul 07 18:11:30 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 1073741824" returned: 0 in 0.877s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:31 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 Jul 07 18:11:31 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d5497b2f-7ad6-4e64-929a-98230fe611e4 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00" by "attach_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d5497b2f-7ad6-4e64-929a-98230fe611e4 tempest-VolumesActionsTest-1352870404 None] Lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00" acquired by "attach_volume" :: waited 0.039s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:31 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d5497b2f-7ad6-4e64-929a-98230fe611e4 tempest-VolumesActionsTest-1352870404 None] Attaching volume 6e625bac-d4ce-4e11-bd0f-f488abd33e00 to instance a484cbea-3210-4bbb-a39c-4bc75a2a5710 at mountpoint /dev/vdb on host None. Jul 07 18:11:31 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d5497b2f-7ad6-4e64-929a-98230fe611e4 tempest-VolumesActionsTest-1352870404 None] Attach volume completed successfully. Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d5497b2f-7ad6-4e64-929a-98230fe611e4 tempest-VolumesActionsTest-1352870404 None] Lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00" released by "attach_volume" :: held 0.192s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:31 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" returned: 0 in 0.772s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb99bee6-94d2-47ec-abbe-3f331350ec36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc51a54-d866-4aca-84c3-820e1645f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:31 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Volume volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 (971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9): created successfully Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc51a54-d866-4aca-84c3-820e1645f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (c3fbb381-cd3f-4475-ac10-89f6b0af0db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:31 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8639ad1f-14af-4c06-a110-22ee5622fc50 tempest-VolumesSnapshotTestJSON-1728726872 None] Created volume successfully. Jul 07 18:11:32 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f96f57de-e1fe-49ec-9dd4-45159e50b547 tempest-VolumesActionsTest-1808296287 None] Terminate volume connection completed successfully. Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f96f57de-e1fe-49ec-9dd4-45159e50b547 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00-detach_volume" by "detach_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Creating offline snapshot ce019637-78bf-4b10-b2ce-a9a6094f7263 of volume 971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f96f57de-e1fe-49ec-9dd4-45159e50b547 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e81d5b-5efc-4e2d-9a58-46dd92358f5a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f96f57de-e1fe-49ec-9dd4-45159e50b547 tempest-VolumesActionsTest-1808296287 None] Detaching volume 6e625bac-d4ce-4e11-bd0f-f488abd33e00 from instance a484cbea-3210-4bbb-a39c-4bc75a2a5710. Jul 07 18:11:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f96f57de-e1fe-49ec-9dd4-45159e50b547 tempest-VolumesActionsTest-1808296287 None] Detach volume completed successfully. Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f96f57de-e1fe-49ec-9dd4-45159e50b547 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:33 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 Jul 07 18:11:33 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-454dbc96-c9b8-467f-bdb3-136d380553b1 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00-detach_volume" by "detach_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-454dbc96-c9b8-467f-bdb3-136d380553b1 tempest-VolumesActionsTest-1352870404 None] Lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00-detach_volume" acquired by "detach_volume" :: waited 0.055s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-454dbc96-c9b8-467f-bdb3-136d380553b1 tempest-VolumesActionsTest-1352870404 None] Volume detach called, but volume not attached. Jul 07 18:11:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-454dbc96-c9b8-467f-bdb3-136d380553b1 tempest-VolumesActionsTest-1352870404 None] Lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:34 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" returned: 0 in 0.983s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:34 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 1G Jul 07 18:11:34 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "cinder-quobyte-6e625bac-d4ce-4e11-bd0f-f488abd33e00" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Lock "cinder-quobyte-6e625bac-d4ce-4e11-bd0f-f488abd33e00" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:34 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5a927f-dc25-46ca-955a-6b6894aac820]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:34 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 Jul 07 18:11:34 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:35 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 1G" returned: 0 in 1.074s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:35 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 Jul 07 18:11:35 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:35 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00" returned: 0 in 0.951s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:35 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00 Jul 07 18:11:35 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:36 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263" returned: 0 in 0.885s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:36 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 is being set with open permissions: ugo+rw Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:36 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 Jul 07 18:11:36 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:36 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6e625bac-d4ce-4e11-bd0f-f488abd33e00" returned: 0 in 0.728s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Lock "cinder-quobyte-6e625bac-d4ce-4e11-bd0f-f488abd33e00" released by "delete_volume" :: held 1.739s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Created reservations ['4200ac69-816f-45ad-aaea-28ca388aff23', '59f13309-203e-4b29-a72b-8c231a8a7b76', '084e129b-599e-4fac-9ca0-7ce1e6c4c9c1', '77327112-a51a-4e74-b766-7ee6ecee7ac7'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:36 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:11:36 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:36 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263" returned: 0 in 0.744s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:36 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.info Jul 07 18:11:36 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:37 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.735s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:37 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:11:37 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Deleted volume successfully. Jul 07 18:11:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6d053025-439b-42bf-ac90-9c9ac17e6cf0 tempest-VolumesActionsTest-1352870404 None] Lock "cinder-6e625bac-d4ce-4e11-bd0f-f488abd33e00-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:37 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.info" returned: 0 in 0.920s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:37 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.info is being set with open permissions: ugo+rw Jul 07 18:11:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:37 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.info Jul 07 18:11:37 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:38 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.info" returned: 0 in 0.696s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.432s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:38 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dc9ec9a1-b49a-48bb-8528-b774b7283c3e tempest-VolumesSnapshotTestJSON-1728726872 None] Create snapshot completed successfully Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (c7c10f7c-d7c4-4b2c-96f0-0b9b3833929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c705bc-15ba-4e0e-a1d9-4114c2e9e0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c705bc-15ba-4e0e-a1d9-4114c2e9e0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-180225555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b6b69f-770e-4a96-a050-607a029a6cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee24897d279428cb9cdd72cf34b0063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce019637-78bf-4b10-b2ce-a9a6094f7263,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:40Z,use_quota=True,user_id='8b38eb2fc5bc4310b9aff408f82013db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba571095-9200-4156-ab8b-b123d45ab3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba571095-9200-4156-ab8b-b123d45ab3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76bf79e-95d4-4fdd-8e11-b13d894156aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76bf79e-95d4-4fdd-8e11-b13d894156aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f1b6b69f-770e-4a96-a050-607a029a6cf0', 'volume_name': 'volume-f1b6b69f-770e-4a96-a050-607a029a6cf0', 'volume_size': 1, 'snapshot_id': 'ce019637-78bf-4b10-b2ce-a9a6094f7263'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a781f926-edce-48c6-a7c5-8eda737a4988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a781f926-edce-48c6-a7c5-8eda737a4988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54fcb31-5c30-48bc-b1b0-54b886ddb555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:40 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Volume f1b6b69f-770e-4a96-a050-607a029a6cf0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f1b6b69f-770e-4a96-a050-607a029a6cf0', 'volume_size': 1, 'snapshot_id': 'ce019637-78bf-4b10-b2ce-a9a6094f7263'} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-ce019637-78bf-4b10-b2ce-a9a6094f7263-f1b6b69f-770e-4a96-a050-607a029a6cf0" by "_create_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-ce019637-78bf-4b10-b2ce-a9a6094f7263-f1b6b69f-770e-4a96-a050-607a029a6cf0" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Creating volume f1b6b69f-770e-4a96-a050-607a029a6cf0 from snapshot ce019637-78bf-4b10-b2ce-a9a6094f7263 {{(pid=86972) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-f1b6b69f-770e-4a96-a050-607a029a6cf0" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-f1b6b69f-770e-4a96-a050-607a029a6cf0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] snapshot: ce019637-78bf-4b10-b2ce-a9a6094f7263, volume: f1b6b69f-770e-4a96-a050-607a029a6cf0, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c441317-f0d1-49e5-bf64-89ba93e0296f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:40 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 Jul 07 18:11:40 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:41 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263" returned: 0 in 0.889s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[80326260-2c37-4ac1-b569-ef67ec90bdba]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:41 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 Jul 07 18:11:41 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-cfcfdd92-4300-4e3d-9735-c1c766e1ea38 req-ccfa33f3-872f-4445-a9ba-1bb39324fac6 tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:41 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" returned: 0 in 0.790s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:11:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:41 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 Jul 07 18:11:41 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (41fdf8ef-fa9c-4088-b136-b73186f4ba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16144480-4573-487d-9c89-4dbdcadf3903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16144480-4573-487d-9c89-4dbdcadf3903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944897605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966b77b1-b758-4d2b-8cdc-69f764229e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:46Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca24ecc-5e75-4005-81ba-fd45dab9dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca24ecc-5e75-4005-81ba-fd45dab9dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07eb927-7161-42af-9382-f63774c26365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a07eb927-7161-42af-9382-f63774c26365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966b77b1-b758-4d2b-8cdc-69f764229e50', 'volume_name': 'volume-966b77b1-b758-4d2b-8cdc-69f764229e50', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70383e67-6b41-4ea0-9cff-376e65641560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70383e67-6b41-4ea0-9cff-376e65641560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2617771d-cc8b-4d99-9316-8576545dd212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:46 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Volume 966b77b1-b758-4d2b-8cdc-69f764229e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966b77b1-b758-4d2b-8cdc-69f764229e50', 'volume_size': 1} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:46 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0" returned: 0 in 4.879s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8389b59-bb3e-4b92-8684-1a258497e685]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:46 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 Jul 07 18:11:46 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:47 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" returned: 0 in 0.958s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:47 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:11:47 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Converted 1024.00 MB image at 209.85 MB/s Jul 07 18:11:47 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 is being set with open permissions: ugo+rw Jul 07 18:11:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:47 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 Jul 07 18:11:47 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:48 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-f1b6b69f-770e-4a96-a050-607a029a6cf0" released by "_copy_volume_from_snapshot" :: held 8.304s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-ce019637-78bf-4b10-b2ce-a9a6094f7263-f1b6b69f-770e-4a96-a050-607a029a6cf0" released by "_create_volume_from_snapshot" :: held 8.337s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.352s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-cfcfdd92-4300-4e3d-9735-c1c766e1ea38 req-ccfa33f3-872f-4445-a9ba-1bb39324fac6 tempest-TestStampPattern-891121631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4452d87-f907-4ada-a211-2b7330ea0657]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-cfcfdd92-4300-4e3d-9735-c1c766e1ea38 req-ccfa33f3-872f-4445-a9ba-1bb39324fac6 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e54fcb31-5c30-48bc-b1b0-54b886ddb555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b6b69f-770e-4a96-a050-607a029a6cf0', 'volume_size': 1, 'snapshot_id': 'ce019637-78bf-4b10-b2ce-a9a6094f7263'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08203992-c221-46a4-b13b-efd931ffc269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:48 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Volume volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 (f1b6b69f-770e-4a96-a050-607a029a6cf0): created successfully Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08203992-c221-46a4-b13b-efd931ffc269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Flow 'volume_create_manager' (c7c10f7c-d7c4-4b2c-96f0-0b9b3833929b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:48 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c786a76c-5907-417f-9181-d10b16be412b tempest-VolumesSnapshotTestJSON-1728726872 None] Created volume successfully. Jul 07 18:11:48 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 Jul 07 18:11:48 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-f1b6b69f-770e-4a96-a050-607a029a6cf0-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-f1b6b69f-770e-4a96-a050-607a029a6cf0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-f1b6b69f-770e-4a96-a050-607a029a6cf0" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-f1b6b69f-770e-4a96-a050-607a029a6cf0" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[93332117-77d6-4756-998a-2d6b2934a7bd]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:49 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 Jul 07 18:11:49 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:49 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-cfcfdd92-4300-4e3d-9735-c1c766e1ea38 req-ccfa33f3-872f-4445-a9ba-1bb39324fac6 tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4" returned: 0 in 0.823s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-cfcfdd92-4300-4e3d-9735-c1c766e1ea38 req-ccfa33f3-872f-4445-a9ba-1bb39324fac6 tempest-TestStampPattern-891121631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.226s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1944897605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966b77b1-b758-4d2b-8cdc-69f764229e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:46Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Creating volume 966b77b1-b758-4d2b-8cdc-69f764229e50 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:11:49 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:49 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50 1073741824 Jul 07 18:11:49 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-cfcfdd92-4300-4e3d-9735-c1c766e1ea38 req-ccfa33f3-872f-4445-a9ba-1bb39324fac6 tempest-TestStampPattern-891121631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-41f6476c-adbd-4332-9874-e0062af4a7b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0490d725-60af-47fb-abed-6e9af6c0554a', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:11:49 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-cfcfdd92-4300-4e3d-9735-c1c766e1ea38 req-ccfa33f3-872f-4445-a9ba-1bb39324fac6 tempest-TestStampPattern-891121631 None] attachment_update completed successfully. Jul 07 18:11:49 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0" returned: 0 in 0.780s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:49 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0 Jul 07 18:11:49 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:50 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50 1073741824" returned: 0 in 1.034s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:50 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50 Jul 07 18:11:50 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:50 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f1b6b69f-770e-4a96-a050-607a029a6cf0" returned: 0 in 0.794s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-f1b6b69f-770e-4a96-a050-607a029a6cf0" released by "delete_volume" :: held 1.630s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Created reservations ['53176d5d-c46c-465d-baac-404eca59824a', '35a8887a-9045-4bd8-8e52-d19037015bc9', 'a5bea267-a879-4e42-9249-327cb02e6a09', '12c84fba-a03e-4eba-86e5-a5ff5979c667'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:50 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:11:50 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:51 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50" returned: 0 in 0.747s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-ce019637-78bf-4b10-b2ce-a9a6094f7263-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2617771d-cc8b-4d99-9316-8576545dd212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966b77b1-b758-4d2b-8cdc-69f764229e50', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119f324c-c385-4a4d-8c64-79e7067e2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-ce019637-78bf-4b10-b2ce-a9a6094f7263-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:51 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Volume volume-966b77b1-b758-4d2b-8cdc-69f764229e50 (966b77b1-b758-4d2b-8cdc-69f764229e50): created successfully Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119f324c-c385-4a4d-8c64-79e7067e2522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (41fdf8ef-fa9c-4088-b136-b73186f4ba46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-ce019637-78bf-4b10-b2ce-a9a6094f7263" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f091dee5-e4f3-4d2d-bdf7-8146cd55147b tempest-VolumesActionsTest-1352870404 None] Created volume successfully. Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-ce019637-78bf-4b10-b2ce-a9a6094f7263" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Deleting offline snapshot ce019637-78bf-4b10-b2ce-a9a6094f7263 of volume 971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] snapshot_file for this snap is: volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2015f083-66f8-45f2-8447-6ac49de49c3c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:51 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 Jul 07 18:11:51 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:51 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.748s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:11:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Deleted volume successfully. Jul 07 18:11:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ba9f87e9-b1c1-4d84-a01b-e5e16c40d922 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-f1b6b69f-770e-4a96-a050-607a029a6cf0-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:52 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263" returned: 0 in 0.791s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed6c9ab-6557-4fc3-8c05-4d63b97023fb]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "cinder-966b77b1-b758-4d2b-8cdc-69f764229e50-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-966b77b1-b758-4d2b-8cdc-69f764229e50-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:52 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 Jul 07 18:11:52 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "cinder-quobyte-966b77b1-b758-4d2b-8cdc-69f764229e50" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-quobyte-966b77b1-b758-4d2b-8cdc-69f764229e50" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2461b217-7a4e-4e69-b369-b30e0c582f28]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:52 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50 Jul 07 18:11:52 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:53 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" returned: 0 in 0.790s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:53 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 Jul 07 18:11:53 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:53 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50" returned: 0 in 0.807s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:53 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50 Jul 07 18:11:53 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:53 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263" returned: 0 in 0.831s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:53 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263 Jul 07 18:11:53 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:53 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-966b77b1-b758-4d2b-8cdc-69f764229e50" returned: 0 in 0.713s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-quobyte-966b77b1-b758-4d2b-8cdc-69f764229e50" released by "delete_volume" :: held 1.566s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Created reservations ['19223dc9-745c-4087-a87e-76824200afc4', '6f83b307-7d09-4692-b84f-2174bacfa067', '1a95cbba-694c-4bf6-a0ae-bfca04540b26', '641f148b-09ff-4162-bf41-b09cca6781ab'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:54 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:11:54 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:54 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9.ce019637-78bf-4b10-b2ce-a9a6094f7263" returned: 0 in 0.786s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-ce019637-78bf-4b10-b2ce-a9a6094f7263" released by "_delete_snapshot" :: held 3.333s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" released by "delete_snapshot" :: held 3.358s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Created reservations ['8e190ce7-8768-47f9-be52-a42e1e5bc1c2', '4e859058-88c9-413b-ac73-16e4fa31d520', 'c7f73942-9c16-46f7-80f0-40adc8472830', 'ea8a4f77-b77d-4459-91e5-fd30e459f486'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Delete snapshot completed successfully. Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d123de7a-34f8-4c8a-a183-cc8d4c1e485c tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-ce019637-78bf-4b10-b2ce-a9a6094f7263-delete_snapshot" released by "delete_snapshot" :: held 3.537s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:54 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.857s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:11:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Deleted volume successfully. Jul 07 18:11:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-65093b39-5059-428c-9911-fa7473e59604 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-966b77b1-b758-4d2b-8cdc-69f764229e50-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (aa1c7a68-4556-40d6-88c1-20030df593b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e960e3d-d7b0-46f3-b77f-8b4743944620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e960e3d-d7b0-46f3-b77f-8b4743944620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1082770373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364e58d7-3173-405c-8bed-a6030f4af4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:55Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc3b935-9a99-4148-b45c-cf8759f46ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc3b935-9a99-4148-b45c-cf8759f46ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0eabad5-d475-4783-80f0-321a6ef01ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0eabad5-d475-4783-80f0-321a6ef01ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364e58d7-3173-405c-8bed-a6030f4af4b3', 'volume_name': 'volume-364e58d7-3173-405c-8bed-a6030f4af4b3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ab9edd-8417-4db4-bd5f-318425c582df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ab9edd-8417-4db4-bd5f-318425c582df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5b9754-0bac-42db-bf4c-6f137ecca181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:55 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Volume 364e58d7-3173-405c-8bed-a6030f4af4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364e58d7-3173-405c-8bed-a6030f4af4b3', 'volume_size': 1} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1082770373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364e58d7-3173-405c-8bed-a6030f4af4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:11:55Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Creating volume 364e58d7-3173-405c-8bed-a6030f4af4b3 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:11:55 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:55 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3 1073741824 Jul 07 18:11:55 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8eb5ed-4c08-413a-8627-5e4a3f4a118a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:55 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 Jul 07 18:11:55 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:56 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3 1073741824" returned: 0 in 0.954s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:56 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3 Jul 07 18:11:56 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:56 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" returned: 0 in 0.902s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:56 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9 Jul 07 18:11:56 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:56 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3" returned: 0 in 0.711s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:11:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5b9754-0bac-42db-bf4c-6f137ecca181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364e58d7-3173-405c-8bed-a6030f4af4b3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ebfbdd-217c-487e-bb5b-12745421f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:11:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Volume volume-364e58d7-3173-405c-8bed-a6030f4af4b3 (364e58d7-3173-405c-8bed-a6030f4af4b3): created successfully Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ebfbdd-217c-487e-bb5b-12745421f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (aa1c7a68-4556-40d6-88c1-20030df593b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:11:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5802e17d-fc37-4224-8cc4-daf4921e5dd3 tempest-VolumesActionsTest-1352870404 None] Created volume successfully. Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "cinder-364e58d7-3173-405c-8bed-a6030f4af4b3-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-364e58d7-3173-405c-8bed-a6030f4af4b3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:57 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" returned: 0 in 0.754s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9" released by "delete_volume" :: held 1.728s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "cinder-quobyte-364e58d7-3173-405c-8bed-a6030f4af4b3" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-quobyte-364e58d7-3173-405c-8bed-a6030f4af4b3" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5103c7f-e386-43de-9860-81da752d56f4]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Created reservations ['f34706d7-4318-4364-b6f8-a3e3c5f9a633', 'f63d72dd-aaf5-46b6-b272-dea570c2085e', '753b29fd-c03b-4be7-b24c-4e767dfeccff', '4adcf783-33fe-456a-8197-43b432eca4a5'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:57 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3 Jul 07 18:11:57 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:57 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:11:57 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-412a8af6-1ac8-481e-a7b2-23bab42d8e89-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-412a8af6-1ac8-481e-a7b2-23bab42d8e89-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "cinder-quobyte-412a8af6-1ac8-481e-a7b2-23bab42d8e89" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-412a8af6-1ac8-481e-a7b2-23bab42d8e89" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ba8ef8-654d-4aad-b9aa-d77ed804f427]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:58 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 Jul 07 18:11:58 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:58 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.707s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:11:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Deleted volume successfully. Jul 07 18:11:58 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3" returned: 0 in 0.832s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:58 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3 Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cf8d526e-d759-4fd1-b57d-a6f2cac6d4e4 tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-971c2af5-d9fe-4f0d-8eff-9a1e9e6055e9-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:58 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-0e218468-fcf8-46ef-b4d9-836257d7abf6 req-23cc46a0-8bfd-449e-9704-c08064ab609b tempest-TestStampPattern-891121631 None] Terminate volume connection completed successfully. Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-0e218468-fcf8-46ef-b4d9-836257d7abf6 req-23cc46a0-8bfd-449e-9704-c08064ab609b tempest-TestStampPattern-891121631 None] Deleting attachment 0490d725-60af-47fb-abed-6e9af6c0554a. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:11:58 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89" returned: 0 in 0.830s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:59 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89 Jul 07 18:11:59 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:59 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-364e58d7-3173-405c-8bed-a6030f4af4b3" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-quobyte-364e58d7-3173-405c-8bed-a6030f4af4b3" released by "delete_volume" :: held 1.613s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Created reservations ['61fe66a7-c220-45f4-b97d-3ac535d2fc38', '5328e997-d98e-44c3-a8b9-aa574c2b9faa', 'eec9e44f-96ea-4031-a8dc-e58bcf538201', '27ada538-8ec7-43aa-b98c-422b1239f5da'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:59 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:11:59 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:59 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-412a8af6-1ac8-481e-a7b2-23bab42d8e89" returned: 0 in 0.701s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-quobyte-412a8af6-1ac8-481e-a7b2-23bab42d8e89" released by "delete_volume" :: held 1.609s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Created reservations ['e4184564-0d6c-4261-995f-72e3b0f5ab72', 'ef57c9c1-340c-4c51-82dc-8e239a992be9', '509fa8fd-291e-4c9d-9abe-36dd578772b4', '88f044f1-8590-4b2e-9868-f40636e20d6a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:11:59 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:11:59 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:11:59 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.718s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:11:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Deleted volume successfully. Jul 07 18:11:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-51503140-4349-4bec-b8ec-2ae43b6be460 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-364e58d7-3173-405c-8bed-a6030f4af4b3-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (9f482249-0675-451f-be38-51bc3ab0ea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee0afcf-22f9-4f94-86a2-a28fdb88b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee0afcf-22f9-4f94-86a2-a28fdb88b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1408615104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bd44a2-bb1c-4390-8cc4-6388eec7d1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:00Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276efa2f-0dd2-4237-b986-56e2a1b6f047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276efa2f-0dd2-4237-b986-56e2a1b6f047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1a6d32-dc16-4600-976b-9124c849b9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df1a6d32-dc16-4600-976b-9124c849b9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40bd44a2-bb1c-4390-8cc4-6388eec7d1b4', 'volume_name': 'volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55d3491-1f8d-4ca6-8b46-cf92d371f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55d3491-1f8d-4ca6-8b46-cf92d371f714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced72919-18fa-4d4f-98f2-af5d0a0854d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:00 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Volume 40bd44a2-bb1c-4390-8cc4-6388eec7d1b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4', 'volume_size': 1} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1408615104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bd44a2-bb1c-4390-8cc4-6388eec7d1b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:00Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Creating volume 40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:12:00 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:00 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 1073741824 Jul 07 18:12:00 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:00 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.722s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:00 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Deleted volume successfully. Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-00142d60-4c3f-4fbe-a5c0-653854eec8be tempest-VolumesSnapshotTestJSON-1728726872 None] Lock "cinder-412a8af6-1ac8-481e-a7b2-23bab42d8e89-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:01 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 1073741824" returned: 0 in 0.971s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:01 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 Jul 07 18:12:01 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:02 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.144s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ced72919-18fa-4d4f-98f2-af5d0a0854d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7780be4a-e48f-418c-8584-298405abaf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Creating offline snapshot 4ab2ff98-74d0-4791-af95-a4c9969ce2c9 of volume 41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:12:02 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Volume volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 (40bd44a2-bb1c-4390-8cc4-6388eec7d1b4): created successfully Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7780be4a-e48f-418c-8584-298405abaf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (9f482249-0675-451f-be38-51bc3ab0ea36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[70488e08-19d3-496b-880e-a0ad1fe6e540]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:02 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5b351d20-1297-4fbb-ad3c-2c129f9ec787 tempest-VolumesActionsTest-1352870404 None] Created volume successfully. Jul 07 18:12:02 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 Jul 07 18:12:02 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "cinder-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "cinder-quobyte-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-quobyte-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe444b12-f045-4fca-bf16-84ed179c762a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:02 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 Jul 07 18:12:02 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:02 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4" returned: 0 in 0.812s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:02 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 1G Jul 07 18:12:02 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:03 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4" returned: 0 in 0.956s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:03 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4 Jul 07 18:12:03 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:03 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 1G" returned: 0 in 0.987s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41f6476c-adbd-4332-9874-e0062af4a7b4 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:03 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41f6476c-adbd-4332-9874-e0062af4a7b4 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 Jul 07 18:12:03 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:04 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4" returned: 0 in 0.727s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-quobyte-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4" released by "delete_volume" :: held 1.741s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Created reservations ['776903da-f182-403c-a672-70e8bf23482c', '3521d127-9dd6-4358-8773-45e6bab8e125', 'bd8ddb6a-7176-4039-9a09-c516c8f07b5d', 'c6a043ac-1d65-4435-b65d-fafc5829710f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:04 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:12:04 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:04 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41f6476c-adbd-4332-9874-e0062af4a7b4 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9" returned: 0 in 0.913s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:04 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 is being set with open permissions: ugo+rw Jul 07 18:12:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:04 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 Jul 07 18:12:04 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:05 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.743s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:05 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Deleted volume successfully. Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6ac030f6-500b-4365-b8a8-ca3dd299a8b8 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-40bd44a2-bb1c-4390-8cc4-6388eec7d1b4-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (8a14df34-8d5e-4df3-928f-a4d5810af453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c8c32b-a128-4079-87ac-c4f2a603822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c8c32b-a128-4079-87ac-c4f2a603822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-134190826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec17e1dc-82cf-4735-b7c6-91505269929d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:05Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6935ec22-58de-4aca-8b73-a76e4ed47a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6935ec22-58de-4aca-8b73-a76e4ed47a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364a16d3-8a44-47c9-b12e-6177b33d4ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364a16d3-8a44-47c9-b12e-6177b33d4ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec17e1dc-82cf-4735-b7c6-91505269929d', 'volume_name': 'volume-ec17e1dc-82cf-4735-b7c6-91505269929d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf761154-06b8-4239-a92d-fc023bb7c096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf761154-06b8-4239-a92d-fc023bb7c096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d07b4f-9b21-431e-8529-bb4ab5119052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:05 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Volume ec17e1dc-82cf-4735-b7c6-91505269929d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec17e1dc-82cf-4735-b7c6-91505269929d', 'volume_size': 1} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:05 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9" returned: 0 in 0.831s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:05 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.info Jul 07 18:12:05 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:06 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.info" returned: 0 in 0.681s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:06 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.info is being set with open permissions: ugo+rw Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:06 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.info Jul 07 18:12:06 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Flow 'volume_create_manager' (1e5714f9-c266-4bfd-abcd-2025a5a1602c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b52efb-b27c-4f51-8749-ac4da70c64a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b52efb-b27c-4f51-8749-ac4da70c64a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-588910655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5368998d-7f1b-4517-a8d4-70cc4db64b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5fb764adc4341db8868d94b18b11fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:07Z,use_quota=True,user_id='faac987038a04446a631d2a6dc3a7e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85daa74a-c38d-4b58-80a5-e984a3d03c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85daa74a-c38d-4b58-80a5-e984a3d03c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056a8b82-e93f-48ee-b327-2ca3ff660c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (056a8b82-e93f-48ee-b327-2ca3ff660c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5368998d-7f1b-4517-a8d4-70cc4db64b17', 'volume_name': 'volume-5368998d-7f1b-4517-a8d4-70cc4db64b17', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c859e61-ee0b-4534-bfe3-d6ebbf16c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c859e61-ee0b-4534-bfe3-d6ebbf16c43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe24893-478f-4ce1-8565-90c9342dbbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Volume 5368998d-7f1b-4517-a8d4-70cc4db64b17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5368998d-7f1b-4517-a8d4-70cc4db64b17', 'volume_size': 1} Jul 07 18:12:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:07 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.info" returned: 0 in 0.661s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-134190826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec17e1dc-82cf-4735-b7c6-91505269929d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:05Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Creating volume ec17e1dc-82cf-4735-b7c6-91505269929d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:12:07 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:07 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d 1073741824 Jul 07 18:12:07 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9a168c0c-c7d6-4130-9bca-c85b570a704c tempest-TestStampPattern-891121631 None] Create snapshot completed successfully Jul 07 18:12:07 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d 1073741824" returned: 0 in 0.846s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:07 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d Jul 07 18:12:07 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:08 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d" returned: 0 in 0.681s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-588910655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5368998d-7f1b-4517-a8d4-70cc4db64b17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5fb764adc4341db8868d94b18b11fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:07Z,use_quota=True,user_id='faac987038a04446a631d2a6dc3a7e61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Creating volume 5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:12:08 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:08 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 1073741824 Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d07b4f-9b21-431e-8529-bb4ab5119052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec17e1dc-82cf-4735-b7c6-91505269929d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:08 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f213d2f-5848-4145-92d9-65d4d089cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:08 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Volume volume-ec17e1dc-82cf-4735-b7c6-91505269929d (ec17e1dc-82cf-4735-b7c6-91505269929d): created successfully Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f213d2f-5848-4145-92d9-65d4d089cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (8a14df34-8d5e-4df3-928f-a4d5810af453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-26ab6a1f-a612-488a-81b0-52acd394c814 tempest-VolumesActionsTest-1352870404 None] Created volume successfully. Jul 07 18:12:09 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 1073741824" returned: 0 in 0.893s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:09 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 Jul 07 18:12:09 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "cinder-ec17e1dc-82cf-4735-b7c6-91505269929d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-ec17e1dc-82cf-4735-b7c6-91505269929d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "cinder-quobyte-ec17e1dc-82cf-4735-b7c6-91505269929d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-quobyte-ec17e1dc-82cf-4735-b7c6-91505269929d" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:09 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7085c58a-9307-4cda-9f16-de72f877f5ee]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:09 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d Jul 07 18:12:09 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:10 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:12:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe24893-478f-4ce1-8565-90c9342dbbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5368998d-7f1b-4517-a8d4-70cc4db64b17', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99572a65-1568-4d36-81fb-499f6de3e81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:10 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Volume volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 (5368998d-7f1b-4517-a8d4-70cc4db64b17): created successfully Jul 07 18:12:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99572a65-1568-4d36-81fb-499f6de3e81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Flow 'volume_create_manager' (1e5714f9-c266-4bfd-abcd-2025a5a1602c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b66cc1af-9ba3-47e0-83b8-48a57379ea25 tempest-VolumesSnapshotListTestJSON-684492697 None] Created volume successfully. Jul 07 18:12:10 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d" returned: 0 in 0.788s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:10 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d Jul 07 18:12:10 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Creating offline snapshot ec932379-2d5c-48d5-82eb-d6b9f6637912 of volume 5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[581abc0c-5206-4ba3-995b-72fa760a8df1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:11 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ec17e1dc-82cf-4735-b7c6-91505269929d" returned: 0 in 0.723s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-quobyte-ec17e1dc-82cf-4735-b7c6-91505269929d" released by "delete_volume" :: held 1.553s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:11 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 Jul 07 18:12:11 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Created reservations ['2e7a031d-00ac-415b-8ae1-03ac8824e8e9', 'fc1435b6-c856-4bd2-8c41-c342a4438d41', '98439441-e0c6-4a75-99ca-1211f912de7f', '7d1d25f8-2f14-4d2e-bbc5-8556f6eff4ee'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:11 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:12:11 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:12 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17" returned: 0 in 0.815s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:12 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 1G Jul 07 18:12:12 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:12 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.744s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:12 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Deleted volume successfully. Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc12011a-745b-4113-8ad4-e0268e0b28a5 tempest-VolumesActionsTest-1808296287 None] Lock "cinder-ec17e1dc-82cf-4735-b7c6-91505269929d-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (51ec7044-a990-4c69-b5d5-4082a1ac515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2765dd-d4c8-4dc3-86db-69a8b654f1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd2765dd-d4c8-4dc3-86db-69a8b654f1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31625338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f81953-51cf-4226-9e2c-ca2311bc3f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:12Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221c30e0-2056-40a6-ab16-0f47ecf86363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221c30e0-2056-40a6-ab16-0f47ecf86363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c114e331-59d5-47e2-9b9b-3ea2fb5a8124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c114e331-59d5-47e2-9b9b-3ea2fb5a8124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63f81953-51cf-4226-9e2c-ca2311bc3f0a', 'volume_name': 'volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e5d70f-fa42-411e-b610-97465c3de0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e5d70f-fa42-411e-b610-97465c3de0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd4f2ca-7ed3-4032-a00b-bd155b3f4ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:12 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Volume 63f81953-51cf-4226-9e2c-ca2311bc3f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a', 'volume_size': 1} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:12 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:12:12 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:13 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 1G" returned: 0 in 0.965s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:13 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 Jul 07 18:12:13 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:13 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.729s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:12:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:12:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:12:13 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912" returned: 0 in 0.745s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:13 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 is being set with open permissions: ugo+rw Jul 07 18:12:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:13 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 Jul 07 18:12:13 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:14 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912" returned: 0 in 0.655s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:14 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.info Jul 07 18:12:14 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:15 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.info" returned: 0 in 0.671s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:15 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.info is being set with open permissions: ugo+rw Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:15 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.info Jul 07 18:12:15 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:15 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.info" returned: 0 in 0.627s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.592s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.248s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31625338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63f81953-51cf-4226-9e2c-ca2311bc3f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d0f67834876411baa8e953636596fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:12Z,use_quota=True,user_id='c5854923bd204bc2bf4a752e7a21b1b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Creating volume 63f81953-51cf-4226-9e2c-ca2311bc3f0a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:12:15 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:12:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:15 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a 1073741824 Jul 07 18:12:15 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1ee829b4-8433-4796-b32f-8805937329dd tempest-VolumesSnapshotListTestJSON-684492697 None] Create snapshot completed successfully Jul 07 18:12:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:16 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a 1073741824" returned: 0 in 0.966s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:16 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=125,cinder:SELECT=108,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:12:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:16 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a Jul 07 18:12:16 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:17 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a" returned: 0 in 0.657s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.796s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=104,cinder:UPDATE=130,cinder:DELETE=13,cinder:INSERT=31 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Creating offline snapshot 8605d0a5-3762-4725-8f82-9d4e9d090ea6 of volume 5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd4f2ca-7ed3-4032-a00b-bd155b3f4ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcbefb1-7d9c-49b0-bdb2-d8dc7f51ee3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0e903f-1bdb-4b70-9a8d-597e50a4ea49]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:17 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Volume volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a (63f81953-51cf-4226-9e2c-ca2311bc3f0a): created successfully Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcbefb1-7d9c-49b0-bdb2-d8dc7f51ee3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Flow 'volume_create_manager' (51ec7044-a990-4c69-b5d5-4082a1ac515d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-325596a1-85a0-432a-9f0f-f49077a4a2f0 tempest-VolumesActionsTest-1352870404 None] Created volume successfully. Jul 07 18:12:17 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 Jul 07 18:12:17 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Flow 'volume_create_manager' (40562f90-3ff5-4d9e-919f-e4c872c400e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491c31f7-d9cf-40ff-966c-2386225d6af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491c31f7-d9cf-40ff-966c-2386225d6af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-583053247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=578fa89f-299c-4524-9752-59326cdab512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d633e9da5e9482aaf303e8726a6e6aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ab2ff98-74d0-4791-af95-a4c9969ce2c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:18Z,use_quota=True,user_id='274a117907a341ca9ac19658e0c4fe17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f182ab9f-8788-480e-9acc-ac48cfbee84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f182ab9f-8788-480e-9acc-ac48cfbee84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afaf6f5-91d6-4b49-9f54-0987aeca1674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afaf6f5-91d6-4b49-9f54-0987aeca1674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '578fa89f-299c-4524-9752-59326cdab512', 'volume_name': 'volume-578fa89f-299c-4524-9752-59326cdab512', 'volume_size': 1, 'snapshot_id': '4ab2ff98-74d0-4791-af95-a4c9969ce2c9'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2a96ff-010b-4580-9eff-aa42d453f1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2a96ff-010b-4580-9eff-aa42d453f1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43e479a-2e7f-476b-852b-24b5cb4cbcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:18 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Volume 578fa89f-299c-4524-9752-59326cdab512: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-578fa89f-299c-4524-9752-59326cdab512', 'volume_size': 1, 'snapshot_id': '4ab2ff98-74d0-4791-af95-a4c9969ce2c9'} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:18 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912" returned: 0 in 0.877s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5368998d-7f1b-4517-a8d4-70cc4db64b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:18 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 1G Jul 07 18:12:18 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Acquiring lock "cinder-63f81953-51cf-4226-9e2c-ca2311bc3f0a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Lock "cinder-63f81953-51cf-4226-9e2c-ca2311bc3f0a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Acquiring lock "cinder-quobyte-63f81953-51cf-4226-9e2c-ca2311bc3f0a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Lock "cinder-quobyte-63f81953-51cf-4226-9e2c-ca2311bc3f0a" acquired by "delete_volume" :: waited 0.012s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92fb111-5534-492e-98e9-e9f83a076ccf]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:18 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a Jul 07 18:12:18 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:19 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 1G" returned: 0 in 0.936s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:19 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 Jul 07 18:12:19 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:19 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a" returned: 0 in 0.855s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:19 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a Jul 07 18:12:19 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:20 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6" returned: 0 in 0.719s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:20 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 is being set with open permissions: ugo+rw Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:20 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 Jul 07 18:12:20 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:20 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-63f81953-51cf-4226-9e2c-ca2311bc3f0a" returned: 0 in 0.717s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Lock "cinder-quobyte-63f81953-51cf-4226-9e2c-ca2311bc3f0a" released by "delete_volume" :: held 1.617s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Created reservations ['b62222c9-0ebb-4814-9651-132752afcc84', '5c14a8d1-9d4b-440b-8db6-06f04e01236f', 'e0693a98-156e-4e5d-9d39-c0f10c1b4695', '89221975-d6de-4170-80a3-58e4ccc56866'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:20 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:12:20 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:20 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.348s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.435s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Acquiring lock "cinder-quobyte-4ab2ff98-74d0-4791-af95-a4c9969ce2c9-578fa89f-299c-4524-9752-59326cdab512" by "_create_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dce91634-bc85-49fa-928c-5ea2b114a36d tempest-VolumesSnapshotListTestJSON-684492697 None] Create snapshot completed successfully Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-4ab2ff98-74d0-4791-af95-a4c9969ce2c9-578fa89f-299c-4524-9752-59326cdab512" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Creating volume 578fa89f-299c-4524-9752-59326cdab512 from snapshot 4ab2ff98-74d0-4791-af95-a4c9969ce2c9 {{(pid=86972) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Acquiring lock "cinder-quobyte-578fa89f-299c-4524-9752-59326cdab512" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-578fa89f-299c-4524-9752-59326cdab512" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] snapshot: 4ab2ff98-74d0-4791-af95-a4c9969ce2c9, volume: 578fa89f-299c-4524-9752-59326cdab512, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[27438df3-7d90-4683-a1ee-6a633e951669]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:21 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.727s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:21 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Deleted volume successfully. Jul 07 18:12:21 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 Jul 07 18:12:21 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d8a46033-b726-4c74-a40c-e51e3ffd0e1f tempest-VolumesActionsTest-1352870404 None] Lock "cinder-63f81953-51cf-4226-9e2c-ca2311bc3f0a-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:21 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9" returned: 0 in 0.848s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41f6476c-adbd-4332-9874-e0062af4a7b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad073bbc-e1f4-47f6-93ce-30531748dea9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:22 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 Jul 07 18:12:22 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:22 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4" returned: 0 in 0.802s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:22 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:12:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:22 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 Jul 07 18:12:22 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512" returned: 0 in 6.332s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:29 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0627c9e-2d61-4a19-a27f-bcc28ff6bbe0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:29 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 Jul 07 18:12:29 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:30 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4" returned: 0 in 1.111s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:30 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:12:30 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Converted 1024.00 MB image at 161.68 MB/s Jul 07 18:12:30 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 is being set with open permissions: ugo+rw Jul 07 18:12:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:30 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 Jul 07 18:12:30 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:30 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512" returned: 0 in 0.732s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-578fa89f-299c-4524-9752-59326cdab512" released by "_copy_volume_from_snapshot" :: held 9.970s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-4ab2ff98-74d0-4791-af95-a4c9969ce2c9-578fa89f-299c-4524-9752-59326cdab512" released by "_create_volume_from_snapshot" :: held 10.011s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.052s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.762s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Creating offline snapshot 90db3a96-7455-472d-87ac-add5e67b7396 of volume 5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:12:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c43e479a-2e7f-476b-852b-24b5cb4cbcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-578fa89f-299c-4524-9752-59326cdab512', 'volume_size': 1, 'snapshot_id': '4ab2ff98-74d0-4791-af95-a4c9969ce2c9'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469b66bb-70c4-4e6f-8035-e79f3b70dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:31 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c58992-cd16-411c-bb5f-081e3b4358d1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:31 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Volume volume-578fa89f-299c-4524-9752-59326cdab512 (578fa89f-299c-4524-9752-59326cdab512): created successfully Jul 07 18:12:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469b66bb-70c4-4e6f-8035-e79f3b70dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Flow 'volume_create_manager' (40562f90-3ff5-4d9e-919f-e4c872c400e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:31 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-181f55e2-9165-43c3-90ac-8d358a212c71 tempest-TestStampPattern-891121631 None] Created volume successfully. Jul 07 18:12:31 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 Jul 07 18:12:31 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:31 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6" returned: 0 in 0.834s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5368998d-7f1b-4517-a8d4-70cc4db64b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:12:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:31 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 1G Jul 07 18:12:31 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:32 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 1G" returned: 0 in 1.139s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:33 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 Jul 07 18:12:33 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:33 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396" returned: 0 in 0.922s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:33 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 is being set with open permissions: ugo+rw Jul 07 18:12:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:33 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 Jul 07 18:12:33 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:34 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396" returned: 0 in 0.653s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.684s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:34 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d14e3e34-463b-4568-b2a3-c91329618257 tempest-VolumesSnapshotListTestJSON-684492697 None] Create snapshot completed successfully Jul 07 18:12:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-90db3a96-7455-472d-87ac-add5e67b7396-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-90db3a96-7455-472d-87ac-add5e67b7396-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-quobyte-90db3a96-7455-472d-87ac-add5e67b7396" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-90db3a96-7455-472d-87ac-add5e67b7396" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Deleting offline snapshot 90db3a96-7455-472d-87ac-add5e67b7396 of volume 5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:12:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] snapshot_file for this snap is: volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:12:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8f5c06-d4ac-445f-ab50-9ff33340008c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:36 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 Jul 07 18:12:36 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:37 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396" returned: 0 in 0.970s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5368998d-7f1b-4517-a8d4-70cc4db64b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:12:37 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a73be1-6e4f-4763-a90e-1b9baf4fae59]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:37 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 Jul 07 18:12:37 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:38 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6" returned: 0 in 0.907s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5368998d-7f1b-4517-a8d4-70cc4db64b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:38 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 Jul 07 18:12:38 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Flow 'volume_create_manager' (bd5dc85e-56ee-41af-99b7-ed7d7e396412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b475fdb7-aa70-44b4-b952-51ec33463647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b475fdb7-aa70-44b4-b952-51ec33463647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-835839708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd19253-4711-432a-a972-b24da2af134c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ff37e1db78486d87513b8d7fad43d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:39Z,use_quota=True,user_id='82d4c666f6f3405fa138a80cee9018de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a239838-9513-433a-8267-91c5042a5523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a239838-9513-433a-8267-91c5042a5523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3f97ec-2d80-4c70-b2fb-93d217ba5281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3f97ec-2d80-4c70-b2fb-93d217ba5281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd19253-4711-432a-a972-b24da2af134c', 'volume_name': 'volume-2cd19253-4711-432a-a972-b24da2af134c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee33730-d7c4-4982-82c0-a7582a3b880f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee33730-d7c4-4982-82c0-a7582a3b880f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7449592f-cc31-4e83-a574-99f9ae59b017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:38 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Volume 2cd19253-4711-432a-a972-b24da2af134c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd19253-4711-432a-a972-b24da2af134c', 'volume_size': 1} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-835839708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd19253-4711-432a-a972-b24da2af134c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ff37e1db78486d87513b8d7fad43d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:39Z,use_quota=True,user_id='82d4c666f6f3405fa138a80cee9018de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Creating volume 2cd19253-4711-432a-a972-b24da2af134c {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:12:38 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:12:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:38 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c 1073741824 Jul 07 18:12:38 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:39 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396" returned: 0 in 1.144s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:39 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396 Jul 07 18:12:39 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:39 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c 1073741824" returned: 0 in 1.012s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:39 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c Jul 07 18:12:39 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:39 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.90db3a96-7455-472d-87ac-add5e67b7396" returned: 0 in 0.772s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-90db3a96-7455-472d-87ac-add5e67b7396" released by "_delete_snapshot" :: held 3.906s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" released by "delete_snapshot" :: held 3.934s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Created reservations ['6419aa14-8dc3-459b-ae69-c014c641432f', '03db53a9-acdb-4f3f-a7e4-8b3cc0d26243', '59c764d5-a9f9-4c28-8e94-fc4168f74706', 'd284b64d-8188-40b6-b63d-3709ebc40339'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Delete snapshot completed successfully. Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-89307552-dc1d-49d6-9fce-047bff175d70 tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-90db3a96-7455-472d-87ac-add5e67b7396-delete_snapshot" released by "delete_snapshot" :: held 4.129s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-8605d0a5-3762-4725-8f82-9d4e9d090ea6-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-8605d0a5-3762-4725-8f82-9d4e9d090ea6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-quobyte-8605d0a5-3762-4725-8f82-9d4e9d090ea6" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-8605d0a5-3762-4725-8f82-9d4e9d090ea6" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Deleting offline snapshot 8605d0a5-3762-4725-8f82-9d4e9d090ea6 of volume 5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] snapshot_file for this snap is: volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb5eb96-03b8-42d1-b897-761570d4a9a9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:40 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 Jul 07 18:12:40 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:40 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c" returned: 0 in 0.942s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7449592f-cc31-4e83-a574-99f9ae59b017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd19253-4711-432a-a972-b24da2af134c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b71b23-dd87-46e3-bb0d-65f1fbdffd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:40 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Volume volume-2cd19253-4711-432a-a972-b24da2af134c (2cd19253-4711-432a-a972-b24da2af134c): created successfully Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b71b23-dd87-46e3-bb0d-65f1fbdffd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Flow 'volume_create_manager' (bd5dc85e-56ee-41af-99b7-ed7d7e396412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ea4f42bb-3a34-425d-9f8a-7ff06ab116f4 tempest-AbsoluteLimitsTests-246387502 None] Created volume successfully. Jul 07 18:12:41 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6" returned: 0 in 0.879s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5368998d-7f1b-4517-a8d4-70cc4db64b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:12:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f22f2ca-d2d4-4a56-af9d-82f803307a51]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:41 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 Jul 07 18:12:41 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Acquiring lock "cinder-2cd19253-4711-432a-a972-b24da2af134c-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Lock "cinder-2cd19253-4711-432a-a972-b24da2af134c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Acquiring lock "cinder-quobyte-2cd19253-4711-432a-a972-b24da2af134c" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Lock "cinder-quobyte-2cd19253-4711-432a-a972-b24da2af134c" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:42 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[043f3c73-85da-4ad5-ad80-6ff6d8f30ff5]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:42 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c Jul 07 18:12:42 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:42 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912" returned: 0 in 0.983s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5368998d-7f1b-4517-a8d4-70cc4db64b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:12:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:42 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 Jul 07 18:12:42 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:43 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c" returned: 0 in 0.966s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:43 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c Jul 07 18:12:43 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:43 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6" returned: 0 in 0.824s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:43 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6 Jul 07 18:12:43 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:43 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2cd19253-4711-432a-a972-b24da2af134c" returned: 0 in 0.719s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Lock "cinder-quobyte-2cd19253-4711-432a-a972-b24da2af134c" released by "delete_volume" :: held 1.747s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Created reservations ['55c28d41-0115-46e7-9767-6ca5e316a158', 'fb430e20-e6c8-4fe9-ad86-7d8d38f6e456', 'f97c1fa3-ac0e-496b-a237-f2797d5b94be', 'da6fd5e6-5a1e-42a1-bf4b-e1562e2aa76b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:43 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.8605d0a5-3762-4725-8f82-9d4e9d090ea6" returned: 0 in 0.690s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-8605d0a5-3762-4725-8f82-9d4e9d090ea6" released by "_delete_snapshot" :: held 3.510s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" released by "delete_snapshot" :: held 3.587s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:44 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:12:44 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Created reservations ['047cf937-5e92-4f2a-bc55-ae1517484011', 'de47af2c-a1e9-4857-82de-cd2e1f04279a', 'c37fb397-8c2c-4588-8ef6-5fc4a2ce5bc8', '94325148-aa86-49af-a854-65554e4d7eb9'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Delete snapshot completed successfully. Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a635f0b-4a48-4138-a753-edae1ea1668e tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-8605d0a5-3762-4725-8f82-9d4e9d090ea6-delete_snapshot" released by "delete_snapshot" :: held 3.919s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-ec932379-2d5c-48d5-82eb-d6b9f6637912-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-ec932379-2d5c-48d5-82eb-d6b9f6637912-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-quobyte-ec932379-2d5c-48d5-82eb-d6b9f6637912" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-ec932379-2d5c-48d5-82eb-d6b9f6637912" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Deleting offline snapshot ec932379-2d5c-48d5-82eb-d6b9f6637912 of volume 5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] snapshot_file for this snap is: volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f443ea-e919-4ac6-8b46-fcf93c663a0b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:44 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.872s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:44 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 Jul 07 18:12:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Deleted volume successfully. Jul 07 18:12:44 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7fc39d70-18ee-4c69-8646-329d4009728a tempest-AbsoluteLimitsTests-246387502 None] Lock "cinder-2cd19253-4711-432a-a972-b24da2af134c-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:45 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912" returned: 0 in 1.007s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5368998d-7f1b-4517-a8d4-70cc4db64b17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:12:45 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6d938-2228-4acf-9e49-341b6128866e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:45 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 Jul 07 18:12:45 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:46 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17" returned: 0 in 0.913s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:46 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 Jul 07 18:12:46 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:47 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:47 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912 Jul 07 18:12:47 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:48 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17.ec932379-2d5c-48d5-82eb-d6b9f6637912" returned: 0 in 0.719s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-ec932379-2d5c-48d5-82eb-d6b9f6637912" released by "_delete_snapshot" :: held 3.647s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" released by "delete_snapshot" :: held 3.680s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:48 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Created reservations ['0a722b65-e868-4273-bb52-63c84625affe', 'ac9e16a4-f146-435a-be41-a59d7abde4fa', '173c7cab-1857-442c-bdeb-977b0f3a1432', 'cbcd3c6e-4819-443c-9cf6-9580225e00b2'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:48 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Delete snapshot completed successfully. Jul 07 18:12:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5b8c319-98e6-4d98-8ace-03f5b92a73aa tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-ec932379-2d5c-48d5-82eb-d6b9f6637912-delete_snapshot" released by "delete_snapshot" :: held 3.862s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-5368998d-7f1b-4517-a8d4-70cc4db64b17-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-5368998d-7f1b-4517-a8d4-70cc4db64b17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:49 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61e3e39-5952-496d-aaab-6df938422254]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:49 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 Jul 07 18:12:49 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:49 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17" returned: 0 in 0.826s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:49 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17 Jul 07 18:12:49 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Flow 'volume_create_manager' (5c255d0e-6797-4980-8bfa-ea5078e9f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b2d81b-67da-40dc-a847-22799e81cd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b2d81b-67da-40dc-a847-22799e81cd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-776355539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9e1fd2-020a-49f1-8877-73fac9284b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dce697193644d4b8c08e36d6b5a7f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:50Z,use_quota=True,user_id='018e7c82dafb441da87bb476eeffe86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d91001a-1f62-43bd-8ee4-7d7c895ed56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d91001a-1f62-43bd-8ee4-7d7c895ed56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b684e3cf-d781-4dd4-bce2-2c7cbeb01a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b684e3cf-d781-4dd4-bce2-2c7cbeb01a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e9e1fd2-020a-49f1-8877-73fac9284b6a', 'volume_name': 'volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6789fd48-69dc-4199-8cec-8ff0257c145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6789fd48-69dc-4199-8cec-8ff0257c145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde051aa-2a84-49bb-8840-10dbc9511a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:50 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Volume 3e9e1fd2-020a-49f1-8877-73fac9284b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a', 'volume_size': 1} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-776355539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9e1fd2-020a-49f1-8877-73fac9284b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dce697193644d4b8c08e36d6b5a7f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:50Z,use_quota=True,user_id='018e7c82dafb441da87bb476eeffe86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Creating volume 3e9e1fd2-020a-49f1-8877-73fac9284b6a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:12:50 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:50 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a 1073741824 Jul 07 18:12:50 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:50 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5368998d-7f1b-4517-a8d4-70cc4db64b17" returned: 0 in 0.668s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-quobyte-5368998d-7f1b-4517-a8d4-70cc4db64b17" released by "delete_volume" :: held 1.581s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Created reservations ['7d942750-5606-401e-8042-834e86c26a65', 'ec346f39-ade3-4be6-bb3a-14a98d887afa', '97ac8fbc-5ef3-4da3-8d4e-ebfb49a2df75', 'fccb24e7-376e-4612-b4d6-fa0a938e18f7'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:50 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:12:50 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:51 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a 1073741824" returned: 0 in 0.941s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:51 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.700s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:51 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Deleted volume successfully. Jul 07 18:12:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-71f7c542-effd-4ecd-a747-92728eb1e5ac tempest-VolumesSnapshotListTestJSON-684492697 None] Lock "cinder-5368998d-7f1b-4517-a8d4-70cc4db64b17-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:51 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a Jul 07 18:12:51 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:52 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a" returned: 0 in 0.706s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:12:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde051aa-2a84-49bb-8840-10dbc9511a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cee02ad-68ec-435d-81ac-c9154c6762f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:52 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Volume volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a (3e9e1fd2-020a-49f1-8877-73fac9284b6a): created successfully Jul 07 18:12:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cee02ad-68ec-435d-81ac-c9154c6762f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Flow 'volume_create_manager' (5c255d0e-6797-4980-8bfa-ea5078e9f172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b6a67c99-d1d2-4879-8555-d46962c0e35c tempest-VolumesTransfersTest-35622583 None] Created volume successfully. Jul 07 18:12:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8ab91c2a-b3d7-43be-9e77-9fb1091a29a3 tempest-VolumesTransfersTest-1591095568 None] Transfer volume completed successfully. Jul 07 18:12:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Acquiring lock "cinder-3e9e1fd2-020a-49f1-8877-73fac9284b6a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Lock "cinder-3e9e1fd2-020a-49f1-8877-73fac9284b6a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Acquiring lock "cinder-quobyte-3e9e1fd2-020a-49f1-8877-73fac9284b6a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Lock "cinder-quobyte-3e9e1fd2-020a-49f1-8877-73fac9284b6a" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57f9571-d256-4c5e-b1c3-8bbf6bc1847c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:54 devstack sudo[98295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a Jul 07 18:12:54 devstack sudo[98295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:55 devstack sudo[98295]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a" returned: 0 in 0.818s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:55 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a Jul 07 18:12:55 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:56 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3e9e1fd2-020a-49f1-8877-73fac9284b6a" returned: 0 in 0.686s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Lock "cinder-quobyte-3e9e1fd2-020a-49f1-8877-73fac9284b6a" released by "delete_volume" :: held 1.547s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:56 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Created reservations ['2287f6f7-d107-47c2-9202-5eaa39be16c2', 'da8277e5-4715-4d95-8a38-1865b2e3cba2', '06d15eb1-defd-4d37-8e56-bbf3dfe9a460', '1c09eb47-fa77-45ff-bedf-30f998d6c49f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:12:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:56 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:12:56 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:57 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.696s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:12:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Deleted volume successfully. Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0e0982ef-cc81-4295-9586-1eeb76c9f14d tempest-VolumesTransfersTest-1713175885 None] Lock "cinder-3e9e1fd2-020a-49f1-8877-73fac9284b6a-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Flow 'volume_create_manager' (f0aa42e7-e8ea-454d-9634-18d4b880cbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05028c0f-9085-434a-a48f-63faedba5903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05028c0f-9085-434a-a48f-63faedba5903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1645884766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7abe7d3-a38f-4e6e-b53a-8b37c20ab946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dce697193644d4b8c08e36d6b5a7f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:57Z,use_quota=True,user_id='018e7c82dafb441da87bb476eeffe86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9255e8-2627-4d4e-a952-409a4c51db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9255e8-2627-4d4e-a952-409a4c51db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332b826f-9036-410d-80e9-9b059c221b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332b826f-9036-410d-80e9-9b059c221b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7abe7d3-a38f-4e6e-b53a-8b37c20ab946', 'volume_name': 'volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792bf0df-cabc-4a5e-95d8-874ff1e37da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792bf0df-cabc-4a5e-95d8-874ff1e37da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcec8f6-c755-4f55-8831-2fa2fc1b351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Volume b7abe7d3-a38f-4e6e-b53a-8b37c20ab946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946', 'volume_size': 1} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1645884766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7abe7d3-a38f-4e6e-b53a-8b37c20ab946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dce697193644d4b8c08e36d6b5a7f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:12:57Z,use_quota=True,user_id='018e7c82dafb441da87bb476eeffe86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Creating volume b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:12:57 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:12:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:57 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 1073741824 Jul 07 18:12:57 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:58 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 1073741824" returned: 0 in 0.885s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:12:58 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 Jul 07 18:12:58 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:12:59 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946" returned: 0 in 0.734s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fcec8f6-c755-4f55-8831-2fa2fc1b351d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8e9719-fc68-4da7-a9c2-19ba821d59ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:12:59 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Volume volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 (b7abe7d3-a38f-4e6e-b53a-8b37c20ab946): created successfully Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8e9719-fc68-4da7-a9c2-19ba821d59ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Flow 'volume_create_manager' (f0aa42e7-e8ea-454d-9634-18d4b880cbc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:12:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2210dead-3bf5-42fb-be5a-dab47bddd32e tempest-VolumesTransfersTest-35622583 None] Created volume successfully. Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Acquiring lock "cinder-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Lock "cinder-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Acquiring lock "cinder-quobyte-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Lock "cinder-quobyte-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd4ed4c-13cb-45b4-a21e-6e5734cf9fea]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:12:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:00 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 Jul 07 18:13:00 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:01 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946" returned: 0 in 1.128s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:01 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946 Jul 07 18:13:01 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:02 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946" returned: 0 in 1.037s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Lock "cinder-quobyte-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946" released by "delete_volume" :: held 2.227s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:02 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Created reservations ['c8f6a943-1f8a-41d0-bdd1-5f9e551f5f1c', 'fd85fc89-80ca-4731-b712-5b2871c29e05', '3a7e7f80-ebdf-46c2-b970-315486e1a366', '0cd565d5-09fa-4622-b129-a41e6b1f15b4'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:02 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:13:02 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:03 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.873s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:03 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Deleted volume successfully. Jul 07 18:13:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bfd5066c-5b07-44ee-a781-f3f89804d2bc tempest-VolumesTransfersTest-1713175885 None] Lock "cinder-b7abe7d3-a38f-4e6e-b53a-8b37c20ab946-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-570e18ee-4058-4913-a875-16cfe3b78625 req-406dbd3c-457b-4f83-bfad-703d1d2feec8 tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-570e18ee-4058-4913-a875-16cfe3b78625 req-406dbd3c-457b-4f83-bfad-703d1d2feec8 tempest-TestStampPattern-891121631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:06 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c773a23-8ed8-4399-b53b-e2dae315b61b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-570e18ee-4058-4913-a875-16cfe3b78625 req-406dbd3c-457b-4f83-bfad-703d1d2feec8 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:06 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 Jul 07 18:13:06 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:07 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-570e18ee-4058-4913-a875-16cfe3b78625 req-406dbd3c-457b-4f83-bfad-703d1d2feec8 tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512" returned: 0 in 0.875s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-570e18ee-4058-4913-a875-16cfe3b78625 req-406dbd3c-457b-4f83-bfad-703d1d2feec8 tempest-TestStampPattern-891121631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-570e18ee-4058-4913-a875-16cfe3b78625 req-406dbd3c-457b-4f83-bfad-703d1d2feec8 tempest-TestStampPattern-891121631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-578fa89f-299c-4524-9752-59326cdab512', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '729b2a30-822a-4466-8ded-82c5c34dfaa6', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:13:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-570e18ee-4058-4913-a875-16cfe3b78625 req-406dbd3c-457b-4f83-bfad-703d1d2feec8 tempest-TestStampPattern-891121631 None] attachment_update completed successfully. Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Flow 'volume_create_manager' (7178e9c0-d650-4c9a-a8c1-c0ed1e5bd120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0213f9-74b1-4956-8a1b-17995392e20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0213f9-74b1-4956-8a1b-17995392e20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-33466814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce10655b-f97b-49a2-96d9-e41b715910f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1980fccf91624bd38773031204d2f7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:11Z,use_quota=True,user_id='68e354f3bacb48d980b93b139c5f2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bf11e0-8714-4e28-8135-758b0cbd7c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76bf11e0-8714-4e28-8135-758b0cbd7c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0fe018-02ae-4909-b175-b3012258b2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0fe018-02ae-4909-b175-b3012258b2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce10655b-f97b-49a2-96d9-e41b715910f3', 'volume_name': 'volume-ce10655b-f97b-49a2-96d9-e41b715910f3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51bbf0d-a7b1-4707-83bd-b85146cad627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51bbf0d-a7b1-4707-83bd-b85146cad627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7ca40e-9bf9-40e2-85e6-d9c7a8e87e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:11 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Volume ce10655b-f97b-49a2-96d9-e41b715910f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce10655b-f97b-49a2-96d9-e41b715910f3', 'volume_size': 1} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-33466814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce10655b-f97b-49a2-96d9-e41b715910f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1980fccf91624bd38773031204d2f7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:11Z,use_quota=True,user_id='68e354f3bacb48d980b93b139c5f2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Creating volume ce10655b-f97b-49a2-96d9-e41b715910f3 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:11 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:13:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:11 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3 1073741824 Jul 07 18:13:11 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:12 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3 1073741824" returned: 0 in 0.980s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:12 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3 Jul 07 18:13:12 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:12 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:13:12 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:12 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3" returned: 0 in 0.754s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df7ca40e-9bf9-40e2-85e6-d9c7a8e87e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce10655b-f97b-49a2-96d9-e41b715910f3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee2b0ca-0614-4a49-9e5e-ff8fbc8ca9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:13 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Volume volume-ce10655b-f97b-49a2-96d9-e41b715910f3 (ce10655b-f97b-49a2-96d9-e41b715910f3): created successfully Jul 07 18:13:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee2b0ca-0614-4a49-9e5e-ff8fbc8ca9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Flow 'volume_create_manager' (7178e9c0-d650-4c9a-a8c1-c0ed1e5bd120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e8f68d4c-827e-4f8b-b125-51626fd91805 tempest-VolumesTransfersV355Test-587365808 None] Created volume successfully. Jul 07 18:13:13 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.089s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:13:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:13:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:13:14 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-07a8401e-6534-4bec-8215-4c543318297d tempest-VolumesTransfersV355Test-2067809149 None] Transfer volume completed successfully. Jul 07 18:13:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Acquiring lock "cinder-ce10655b-f97b-49a2-96d9-e41b715910f3-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Lock "cinder-ce10655b-f97b-49a2-96d9-e41b715910f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Acquiring lock "cinder-quobyte-ce10655b-f97b-49a2-96d9-e41b715910f3" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Lock "cinder-quobyte-ce10655b-f97b-49a2-96d9-e41b715910f3" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:15 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b922ce4a-5574-4a68-a3fd-f4b53638ca3e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:15 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3 Jul 07 18:13:15 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-78ec0ab0-a81c-4365-91e0-35779bd50e51 req-41330ec6-1971-4251-89df-ea1e783531a8 tempest-TestStampPattern-891121631 None] Terminate volume connection completed successfully. Jul 07 18:13:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-78ec0ab0-a81c-4365-91e0-35779bd50e51 req-41330ec6-1971-4251-89df-ea1e783531a8 tempest-TestStampPattern-891121631 None] Deleting attachment 729b2a30-822a-4466-8ded-82c5c34dfaa6. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:13:16 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3" returned: 0 in 0.820s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:16 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3 Jul 07 18:13:16 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:16 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ce10655b-f97b-49a2-96d9-e41b715910f3" returned: 0 in 0.696s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Lock "cinder-quobyte-ce10655b-f97b-49a2-96d9-e41b715910f3" released by "delete_volume" :: held 1.565s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Created reservations ['681a2df9-f8d4-484c-b4e2-20076ae3bb56', '19f3868c-c9a7-4afe-9a22-e67b521aaa76', '3f26485d-955a-4738-a19d-01d154d611b3', 'e3bfce9a-7388-4dc2-958b-065287f9e766'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:16 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:13:16 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:17 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.663s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:17 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Deleted volume successfully. Jul 07 18:13:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-91fc0df8-3960-4382-bc1c-4f3b22983eac tempest-VolumesTransfersV355Test-1804810542 None] Lock "cinder-ce10655b-f97b-49a2-96d9-e41b715910f3-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=87,cinder:DELETE=7,cinder:SELECT=64,cinder:INSERT=17 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=80,cinder:SELECT=70,cinder:INSERT=23,cinder:DELETE=7 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Flow 'volume_create_manager' (8e755983-a03c-4690-94ab-4d52d2234e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15cf4795-a4e5-4323-914e-ea7c7db53a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15cf4795-a4e5-4323-914e-ea7c7db53a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1086886625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1e3623-fe92-4bec-95e7-40433e50ee20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bdee72c5c5419fa98a3c5c9807b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='5c82cb44fac84314b8e0849806fe060a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e078c185-90a1-4578-b333-b9da95bdec4a),volume_type_id=e078c185-90a1-4578-b333-b9da95bdec4a)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2baba4d8-c457-4f05-bfdd-98fbabedc507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2baba4d8-c457-4f05-bfdd-98fbabedc507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9f3fc7-7faf-4e8c-be28-a940106ca212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9f3fc7-7faf-4e8c-be28-a940106ca212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1e3623-fe92-4bec-95e7-40433e50ee20', 'volume_name': 'volume-3b1e3623-fe92-4bec-95e7-40433e50ee20', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2103fdd7-84b4-4dcb-86b7-9634b59e9fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2103fdd7-84b4-4dcb-86b7-9634b59e9fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cd173c-688a-4ee1-a472-a121f7d6ea49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Volume 3b1e3623-fe92-4bec-95e7-40433e50ee20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1e3623-fe92-4bec-95e7-40433e50ee20', 'volume_size': 1} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1086886625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b1e3623-fe92-4bec-95e7-40433e50ee20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bdee72c5c5419fa98a3c5c9807b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='5c82cb44fac84314b8e0849806fe060a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e078c185-90a1-4578-b333-b9da95bdec4a),volume_type_id=e078c185-90a1-4578-b333-b9da95bdec4a)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Creating volume 3b1e3623-fe92-4bec-95e7-40433e50ee20 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:18 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:18 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 1073741824 Jul 07 18:13:18 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Flow 'volume_create_manager' (8e72a294-edc0-439a-8f80-abf40e0339d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799c1dd0-6e14-4455-9de2-ae119336f70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799c1dd0-6e14-4455-9de2-ae119336f70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1208678057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc417413-3b2a-43ad-964d-9e4edce42f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1980fccf91624bd38773031204d2f7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='68e354f3bacb48d980b93b139c5f2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4868e77a-3fdc-49bb-88c3-290d69101bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4868e77a-3fdc-49bb-88c3-290d69101bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f18fc52-2291-4350-ae8b-8a2a3dec85c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f18fc52-2291-4350-ae8b-8a2a3dec85c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc417413-3b2a-43ad-964d-9e4edce42f65', 'volume_name': 'volume-cc417413-3b2a-43ad-964d-9e4edce42f65', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afd4681-c51d-43ed-a2cd-2df9fa5908a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3afd4681-c51d-43ed-a2cd-2df9fa5908a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b81d204-8bbd-4c36-972a-79c5e4c53bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Volume cc417413-3b2a-43ad-964d-9e4edce42f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc417413-3b2a-43ad-964d-9e4edce42f65', 'volume_size': 1} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Flow 'volume_create_manager' (2d591007-b5aa-4311-8c27-923ca2adbf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7defd46a-5f0a-4024-b57c-67bdd7c8af7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7defd46a-5f0a-4024-b57c-67bdd7c8af7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1129608566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ecc524-30f8-4a6e-b97f-fe283ee0e627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bdee72c5c5419fa98a3c5c9807b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:19Z,use_quota=True,user_id='5c82cb44fac84314b8e0849806fe060a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3885ae8c-f86a-4a59-bad4-da060fa0c45e),volume_type_id=3885ae8c-f86a-4a59-bad4-da060fa0c45e)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e523c02-4ba0-41d2-a763-e5af399c37ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e523c02-4ba0-41d2-a763-e5af399c37ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa19102-fd50-4889-912e-e5d72b8f725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa19102-fd50-4889-912e-e5d72b8f725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ecc524-30f8-4a6e-b97f-fe283ee0e627', 'volume_name': 'volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37292673-96e7-47f6-a8d9-57fa75372c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37292673-96e7-47f6-a8d9-57fa75372c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f02160a-1995-4275-8734-b0fd5e59b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:18 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Volume d4ecc524-30f8-4a6e-b97f-fe283ee0e627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627', 'volume_size': 1} Jul 07 18:13:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Flow 'volume_create_manager' (755526b0-0931-4647-83cc-15dadd60ce03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0f6440-0e4c-479d-a623-7e9dbe97cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0f6440-0e4c-479d-a623-7e9dbe97cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1653407456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a9843e-a1d1-4178-9439-d17d2180a6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bdee72c5c5419fa98a3c5c9807b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:19Z,use_quota=True,user_id='5c82cb44fac84314b8e0849806fe060a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e92818f-f3e9-44f1-b194-cc45b37cedee),volume_type_id=3e92818f-f3e9-44f1-b194-cc45b37cedee)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79505b96-adaf-43b9-9c31-7562590665a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79505b96-adaf-43b9-9c31-7562590665a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a06a0fa-717b-4849-9a42-6f32e569746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.image.glance [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Creating Keystone auth plugin from conf {{(pid=86972) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:13:19 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 1073741824" returned: 0 in 1.259s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:19 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 Jul 07 18:13:19 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a06a0fa-717b-4849-9a42-6f32e569746f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e9a9843e-a1d1-4178-9439-d17d2180a6a4', 'volume_name': 'volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4', 'volume_size': 1, 'image_id': '0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--175927882', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1bdee72c5c5419fa98a3c5c9807b8dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'created_at': datetime.datetime(2026, 7, 7, 16, 13, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0042b1ee-3b3e-4733-b911-7a57fb2b578d/file', 'properties': {}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c305e1-8a62-4235-a4db-64176cb87ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c305e1-8a62-4235-a4db-64176cb87ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14712778-f021-4f64-83a6-4eaa9a8c551b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:19 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Volume e9a9843e-a1d1-4178-9439-d17d2180a6a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4', 'volume_size': 1, 'image_id': '0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--175927882', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1bdee72c5c5419fa98a3c5c9807b8dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'created_at': datetime.datetime(2026, 7, 7, 16, 13, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0042b1ee-3b3e-4733-b911-7a57fb2b578d/file', 'properties': {}}, 'image_service': } Jul 07 18:13:19 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Trying to clone e9a9843e-a1d1-4178-9439-d17d2180a6a4 from image 0042b1ee-3b3e-4733-b911-7a57fb2b578d at location (None, [{'url': 'file:///opt/stack/data/glance/images/0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'metadata': {}}]). {{(pid=86972) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 18:13:20 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20" returned: 0 in 0.735s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.813s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1208678057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc417413-3b2a-43ad-964d-9e4edce42f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1980fccf91624bd38773031204d2f7cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:18Z,use_quota=True,user_id='68e354f3bacb48d980b93b139c5f2911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Creating volume cc417413-3b2a-43ad-964d-9e4edce42f65 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:20 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:20 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65 1073741824 Jul 07 18:13:20 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cd173c-688a-4ee1-a472-a121f7d6ea49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1e3623-fe92-4bec-95e7-40433e50ee20', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e1057b-36b3-4d02-8baf-38016ad4e901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:20 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Volume volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 (3b1e3623-fe92-4bec-95e7-40433e50ee20): created successfully Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e1057b-36b3-4d02-8baf-38016ad4e901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Flow 'volume_create_manager' (8e755983-a03c-4690-94ab-4d52d2234e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ff62c820-5a0f-49bc-ab51-1b9c876c6dd4 tempest-TestInstancesWithCinderVolumes-1055789454 None] Created volume successfully. Jul 07 18:13:21 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65 1073741824" returned: 0 in 1.040s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:21 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65 Jul 07 18:13:21 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:22 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65" returned: 0 in 0.865s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.595s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1129608566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ecc524-30f8-4a6e-b97f-fe283ee0e627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bdee72c5c5419fa98a3c5c9807b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:19Z,use_quota=True,user_id='5c82cb44fac84314b8e0849806fe060a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3885ae8c-f86a-4a59-bad4-da060fa0c45e),volume_type_id=3885ae8c-f86a-4a59-bad4-da060fa0c45e)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Creating volume d4ecc524-30f8-4a6e-b97f-fe283ee0e627 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:22 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:22 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 1073741824 Jul 07 18:13:22 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b81d204-8bbd-4c36-972a-79c5e4c53bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc417413-3b2a-43ad-964d-9e4edce42f65', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcda90e1-d5ce-476f-af11-1f86459d3894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:22 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Volume volume-cc417413-3b2a-43ad-964d-9e4edce42f65 (cc417413-3b2a-43ad-964d-9e4edce42f65): created successfully Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcda90e1-d5ce-476f-af11-1f86459d3894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:22 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Flow 'volume_create_manager' (8e72a294-edc0-439a-8f80-abf40e0339d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:22 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-619414ea-7f83-4b1c-ba68-8146c9f8fa0d tempest-VolumesTransfersV355Test-587365808 None] Created volume successfully. Jul 07 18:13:23 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 1073741824" returned: 0 in 0.893s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:23 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 Jul 07 18:13:23 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Acquiring lock "cinder-cc417413-3b2a-43ad-964d-9e4edce42f65-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Lock "cinder-cc417413-3b2a-43ad-964d-9e4edce42f65-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Acquiring lock "cinder-quobyte-cc417413-3b2a-43ad-964d-9e4edce42f65" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Lock "cinder-quobyte-cc417413-3b2a-43ad-964d-9e4edce42f65" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD, size 20.69 MB, duration 4.02 sec {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:13:23 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Image download 20.69 MB at 5.15 MB/s Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cf7369-ffa3-4841-986b-023829d71a80]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94c2c87-f38c-4a28-9ae5-969dd5fe6124]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:24 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65 Jul 07 18:13:24 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:24 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD Jul 07 18:13:24 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:24 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627" returned: 0 in 0.839s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f02160a-1995-4275-8734-b0fd5e59b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfe2ab2-2ebc-407d-b5a8-228644a7a17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:24 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Volume volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 (d4ecc524-30f8-4a6e-b97f-fe283ee0e627): created successfully Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfe2ab2-2ebc-407d-b5a8-228644a7a17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Flow 'volume_create_manager' (2d591007-b5aa-4311-8c27-923ca2adbf4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-099d2bc2-5969-49d0-bb49-b9c975b1bd62 tempest-TestInstancesWithCinderVolumes-1055789454 None] Created volume successfully. Jul 07 18:13:24 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Temporary image 0042b1ee-3b3e-4733-b911-7a57fb2b578d is fetched for user 5c82cb44fac84314b8e0849806fe060a. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:13:24 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65" returned: 0 in 0.872s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:24 devstack sudo[98917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65 Jul 07 18:13:24 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ba0f2-a2ba-4316-a540-cd3dff3a3860]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:24 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD Jul 07 18:13:24 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:25 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-cc417413-3b2a-43ad-964d-9e4edce42f65" returned: 0 in 0.651s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Lock "cinder-quobyte-cc417413-3b2a-43ad-964d-9e4edce42f65" released by "delete_volume" :: held 1.585s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Created reservations ['b777f8d2-a673-4900-86f9-5535ed5cef22', 'f78aa679-0365-40db-9a88-53cbb2490c48', 'f9f17beb-75d6-4f77-b78f-1e22af74e9db', 'caa63ae2-f7a0-4b8e-9f17-0617c5a31e4a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:25 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:13:25 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:25 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD" returned: 0 in 0.873s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1653407456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a9843e-a1d1-4178-9439-d17d2180a6a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1bdee72c5c5419fa98a3c5c9807b8dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:19Z,use_quota=True,user_id='5c82cb44fac84314b8e0849806fe060a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e92818f-f3e9-44f1-b194-cc45b37cedee),volume_type_id=3e92818f-f3e9-44f1-b194-cc45b37cedee)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Creating volume e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:25 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:13:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:25 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 1073741824 Jul 07 18:13:25 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:26 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.668s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Deleted volume successfully. Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-05e8fa96-5687-4143-bb62-13f621762700 tempest-VolumesTransfersV355Test-1804810542 None] Lock "cinder-cc417413-3b2a-43ad-964d-9e4edce42f65-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Acquiring lock "cinder-578fa89f-299c-4524-9752-59326cdab512-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Lock "cinder-578fa89f-299c-4524-9752-59326cdab512-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Acquiring lock "cinder-quobyte-578fa89f-299c-4524-9752-59326cdab512" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-578fa89f-299c-4524-9752-59326cdab512" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40a11a0-8ce9-439b-a10c-ad3b77488314]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:26 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 1073741824" returned: 0 in 1.007s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:26 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 Jul 07 18:13:26 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:26 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 Jul 07 18:13:26 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:27 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512" returned: 0 in 0.854s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:27 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4" returned: 0 in 0.725s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:27 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512 Jul 07 18:13:27 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:27 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Attempting download of 0042b1ee-3b3e-4733-b911-7a57fb2b578d ((None, [{'url': 'file:///opt/stack/data/glance/images/0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'metadata': {}}])) to volume e9a9843e-a1d1-4178-9439-d17d2180a6a4. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:13:27 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cdd752-f10d-4433-b3dd-495c81de4476]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0042b1ee-3b3e-4733-b911-7a57fb2b578d_faun5vy1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:27 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0042b1ee-3b3e-4733-b911-7a57fb2b578d_faun5vy1 Jul 07 18:13:27 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:28 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0042b1ee-3b3e-4733-b911-7a57fb2b578d_faun5vy1" returned: 0 in 0.777s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0042b1ee-3b3e-4733-b911-7a57fb2b578d_faun5vy1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:28 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-578fa89f-299c-4524-9752-59326cdab512" returned: 0 in 0.926s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-578fa89f-299c-4524-9752-59326cdab512" released by "delete_volume" :: held 1.836s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Created reservations ['33c9ab1a-52fd-45f5-bef0-f98d05ab0df3', 'cae1537e-8aac-4fdb-86ad-e2b7c1ec9820', '8098a4ee-8abf-45f6-9ec2-b0f49b06b146', '16f98aaa-d6e8-445a-a0f4-ae29153aefbf'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:28 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0042b1ee-3b3e-4733-b911-7a57fb2b578d_faun5vy1 Jul 07 18:13:28 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:28 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:13:28 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Acquiring lock "cinder-4ab2ff98-74d0-4791-af95-a4c9969ce2c9-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Lock "cinder-4ab2ff98-74d0-4791-af95-a4c9969ce2c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Acquiring lock "cinder-quobyte-41f6476c-adbd-4332-9874-e0062af4a7b4" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-41f6476c-adbd-4332-9874-e0062af4a7b4" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Acquiring lock "cinder-quobyte-4ab2ff98-74d0-4791-af95-a4c9969ce2c9" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-4ab2ff98-74d0-4791-af95-a4c9969ce2c9" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Deleting offline snapshot 4ab2ff98-74d0-4791-af95-a4c9969ce2c9 of volume 41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] snapshot_file for this snap is: volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c4686-98a4-4b5f-9335-ea371b8224af]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:29 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0042b1ee-3b3e-4733-b911-7a57fb2b578d_faun5vy1" returned: 1 in 1.075s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0042b1ee-3b3e-4733-b911-7a57fb2b578d_faun5vy1' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b195898-d5a3-463b-a1c0-6f250db6e8a1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:29 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 Jul 07 18:13:29 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:29 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.960s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:29 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD Jul 07 18:13:29 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:29 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Deleted volume successfully. Jul 07 18:13:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ef9a31b-571f-4beb-aa08-c495fdc71087 tempest-TestStampPattern-891121631 None] Lock "cinder-578fa89f-299c-4524-9752-59326cdab512-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:30 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9" returned: 0 in 0.944s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41f6476c-adbd-4332-9874-e0062af4a7b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:13:30 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:30 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] 0042b1ee-3b3e-4733-b911-7a57fb2b578d was qcow2, converting to raw {{(pid=86972) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:13:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:30 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ff15e1-585f-40c5-8e7b-17d67ed7eeac]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:30 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 Jul 07 18:13:30 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:30 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 Jul 07 18:13:30 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:31 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:31 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 Jul 07 18:13:31 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:32 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9" returned: 0 in 0.867s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:32 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9 Jul 07 18:13:32 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:32 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4" returned: 0 in 2.268s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0042b1ee-3b3e-4733-b911-7a57fb2b578d_9c00zvrxdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:13:32 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Converted 112.00 MB image at 49.34 MB/s Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:32 devstack sudo[98994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 1G Jul 07 18:13:32 devstack sudo[98994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Flow 'volume_create_manager' (a40f5c25-d85f-49be-b944-849b0574fe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef94236-57ba-4301-bb25-064226a5e7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef94236-57ba-4301-bb25-064226a5e7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-423658682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c286af96-48c0-4ed9-947e-c4444a8d6d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e167590dd670412aad2047d82013d603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:33Z,use_quota=True,user_id='6554b371f2ef490383d7e1db8534e632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbd24a7-818e-47e1-a0d2-89800ef3dbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbd24a7-818e-47e1-a0d2-89800ef3dbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43ec459-26b1-4858-9afc-ed62c6888446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a43ec459-26b1-4858-9afc-ed62c6888446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c286af96-48c0-4ed9-947e-c4444a8d6d83', 'volume_name': 'volume-c286af96-48c0-4ed9-947e-c4444a8d6d83', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694a2409-c830-4327-875b-75fee1172273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694a2409-c830-4327-875b-75fee1172273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5ca488-0312-43e9-8221-454bdb9b160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:32 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Volume c286af96-48c0-4ed9-947e-c4444a8d6d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c286af96-48c0-4ed9-947e-c4444a8d6d83', 'volume_size': 1} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-423658682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c286af96-48c0-4ed9-947e-c4444a8d6d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e167590dd670412aad2047d82013d603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:33Z,use_quota=True,user_id='6554b371f2ef490383d7e1db8534e632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Creating volume c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:32 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:13:32 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4.4ab2ff98-74d0-4791-af95-a4c9969ce2c9" returned: 0 in 0.735s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:32 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 1073741824 Jul 07 18:13:32 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-4ab2ff98-74d0-4791-af95-a4c9969ce2c9" released by "_delete_snapshot" :: held 3.544s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-41f6476c-adbd-4332-9874-e0062af4a7b4" released by "delete_snapshot" :: held 3.593s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Created reservations ['d969096e-490f-4727-8a86-ef80d2e06069', '1c5f8c08-184f-4298-85e1-f9e9a317ea04', '3c2823cc-c846-40a5-a1c7-69747e172b02', 'e3462854-62a7-4dcb-a526-dd8f23322b0a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:32 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Delete snapshot completed successfully. Jul 07 18:13:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b2973f04-5325-40fe-aebf-989c44de8c36 tempest-TestStampPattern-891121631 None] Lock "cinder-4ab2ff98-74d0-4791-af95-a4c9969ce2c9-delete_snapshot" released by "delete_snapshot" :: held 3.751s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:33 devstack sudo[98994]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 1G" returned: 0 in 0.747s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:33 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[438eb61e-da15-4645-a67d-96437d827686]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:33 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 Jul 07 18:13:33 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:33 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 1073741824" returned: 0 in 0.978s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:33 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 Jul 07 18:13:33 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:34 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4" returned: 0 in 0.912s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:34 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 Jul 07 18:13:34 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:34 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83" returned: 0 in 0.752s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:13:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5ca488-0312-43e9-8221-454bdb9b160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c286af96-48c0-4ed9-947e-c4444a8d6d83', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69970f2-e561-44a2-bdfc-961b2679e8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:34 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Volume volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 (c286af96-48c0-4ed9-947e-c4444a8d6d83): created successfully Jul 07 18:13:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69970f2-e561-44a2-bdfc-961b2679e8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Flow 'volume_create_manager' (a40f5c25-d85f-49be-b944-849b0574fe02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:34 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8cf18bd0-e85a-4e93-93e4-6aea6acf2799 tempest-VolumesCloneTest-608692371 None] Created volume successfully. Jul 07 18:13:35 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4" returned: 1 in 0.959s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Downloaded image 0042b1ee-3b3e-4733-b911-7a57fb2b578d ((None, [{'url': 'file:///opt/stack/data/glance/images/0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'metadata': {}}])) to volume e9a9843e-a1d1-4178-9439-d17d2180a6a4 successfully. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Temporary image 0042b1ee-3b3e-4733-b911-7a57fb2b578d for user 5c82cb44fac84314b8e0849806fe060a is deleted. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Marking volume e9a9843e-a1d1-4178-9439-d17d2180a6a4 as bootable. {{(pid=86972) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Copying metadata from image 0042b1ee-3b3e-4733-b911-7a57fb2b578d to e9a9843e-a1d1-4178-9439-d17d2180a6a4. {{(pid=86972) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Creating volume glance metadata for volume e9a9843e-a1d1-4178-9439-d17d2180a6a4 backed by image 0042b1ee-3b3e-4733-b911-7a57fb2b578d with: {'image_id': '0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'image_name': 'tempest-scenario-img--175927882', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86972) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14712778-f021-4f64-83a6-4eaa9a8c551b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4', 'volume_size': 1, 'image_id': '0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--175927882', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b1bdee72c5c5419fa98a3c5c9807b8dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0042b1ee-3b3e-4733-b911-7a57fb2b578d', 'created_at': datetime.datetime(2026, 7, 7, 16, 13, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 13, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0042b1ee-3b3e-4733-b911-7a57fb2b578d/file', 'properties': {}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02447f56-518f-432f-a089-ab8fdcb08847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Volume volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 (e9a9843e-a1d1-4178-9439-d17d2180a6a4): created successfully Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02447f56-518f-432f-a089-ab8fdcb08847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Flow 'volume_create_manager' (755526b0-0931-4647-83cc-15dadd60ce03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-bd524e57-e33b-48c2-af08-d451de43d622 tempest-TestInstancesWithCinderVolumes-1055789454 None] Created volume successfully. Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Flow 'volume_create_manager' (23a2ee4c-7ba3-454d-8d2c-d99ce00510d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8341ffd-d061-4adc-a58a-f00b037b663c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8341ffd-d061-4adc-a58a-f00b037b663c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-107054705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b713bb3c-6471-4daa-8026-5e99a19bbca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e167590dd670412aad2047d82013d603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:13:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c286af96-48c0-4ed9-947e-c4444a8d6d83,status='creating',terminated_at=None,updated_at=2026-07-07T16:13:35Z,use_quota=True,user_id='6554b371f2ef490383d7e1db8534e632',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52606b73-7c5f-4b06-a47b-7d3a426b8efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52606b73-7c5f-4b06-a47b-7d3a426b8efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2952461-57c0-4deb-aca5-440d150516e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2952461-57c0-4deb-aca5-440d150516e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b713bb3c-6471-4daa-8026-5e99a19bbca7', 'volume_name': 'volume-b713bb3c-6471-4daa-8026-5e99a19bbca7', 'volume_size': 2, 'source_volid': 'c286af96-48c0-4ed9-947e-c4444a8d6d83', 'source_volstatus': 'available'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db19dcf-5794-4c63-b5ca-4941471eb561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db19dcf-5794-4c63-b5ca-4941471eb561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead185fa-27b5-4e20-a255-72b23e922c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Volume b713bb3c-6471-4daa-8026-5e99a19bbca7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b713bb3c-6471-4daa-8026-5e99a19bbca7', 'volume_size': 2, 'source_volid': 'c286af96-48c0-4ed9-947e-c4444a8d6d83', 'source_volstatus': 'available'} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:35 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Cloning volume c286af96-48c0-4ed9-947e-c4444a8d6d83 to volume b713bb3c-6471-4daa-8026-5e99a19bbca7 Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Creating offline snapshot 5af4b426-8f38-4a3f-b4ba-eebfd22154d2 of volume c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf32b31-6c3a-4d0f-92ef-b8a79869420b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:35 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 Jul 07 18:13:35 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:36 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83" returned: 0 in 0.958s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:36 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 1G Jul 07 18:13:36 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:37 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 1G" returned: 0 in 1.141s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:37 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 Jul 07 18:13:37 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:38 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2" returned: 0 in 0.786s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:38 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 is being set with open permissions: ugo+rw Jul 07 18:13:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:38 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 Jul 07 18:13:38 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:39 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:39 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.info Jul 07 18:13:39 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:39 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.info" returned: 0 in 0.665s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:39 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.info is being set with open permissions: ugo+rw Jul 07 18:13:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:39 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.info Jul 07 18:13:39 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:40 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.info" returned: 0 in 0.649s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Acquiring lock "cinder-quobyte-b713bb3c-6471-4daa-8026-5e99a19bbca7" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Lock "cinder-quobyte-b713bb3c-6471-4daa-8026-5e99a19bbca7" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] snapshot: 5af4b426-8f38-4a3f-b4ba-eebfd22154d2, volume: b713bb3c-6471-4daa-8026-5e99a19bbca7, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8513d2-3278-4c62-9738-a66e7d6250c4]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:40 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 Jul 07 18:13:40 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:41 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2" returned: 0 in 0.796s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c286af96-48c0-4ed9-947e-c4444a8d6d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:13:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:13:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:13:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5f98eb-47c3-4828-93fe-733b3dafba8e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:41 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 Jul 07 18:13:41 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:42 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83" returned: 0 in 0.908s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:42 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:13:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:42 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 Jul 07 18:13:42 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Acquiring lock "cinder-41f6476c-adbd-4332-9874-e0062af4a7b4-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Lock "cinder-41f6476c-adbd-4332-9874-e0062af4a7b4-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Acquiring lock "cinder-quobyte-41f6476c-adbd-4332-9874-e0062af4a7b4" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-41f6476c-adbd-4332-9874-e0062af4a7b4" acquired by "delete_volume" :: waited 0.058s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:45 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a947802-7d49-4f26-bcea-41004dc76f78]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:45 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 Jul 07 18:13:45 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:46 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4" returned: 0 in 1.636s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:46 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4 Jul 07 18:13:46 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:48 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-41f6476c-adbd-4332-9874-e0062af4a7b4" returned: 0 in 1.454s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Lock "cinder-quobyte-41f6476c-adbd-4332-9874-e0062af4a7b4" released by "delete_volume" :: held 3.259s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Created reservations ['5c6322de-0889-460c-ac23-e4ea3c689a57', 'cf390b28-aebc-4228-b4f6-7d6a42b61521', '472a3404-6ecb-4108-ae28-439018430a1f', '42d67780-12db-4654-a29c-199e685732c0'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:48 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7" returned: 0 in 6.172s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa65477e-c417-42fc-9c1a-2ede94acb35f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:48 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:13:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:48 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:48 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 Jul 07 18:13:48 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:49 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.666s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:49 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:49 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Deleted volume successfully. Jul 07 18:13:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83f105b8-e7e1-41ed-90ff-c1020b082ab1 tempest-TestStampPattern-891121631 None] Lock "cinder-41f6476c-adbd-4332-9874-e0062af4a7b4-delete_volume" released by "delete_volume" :: held 4.371s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:49 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83" returned: 0 in 0.989s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:49 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:13:49 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Converted 1024.00 MB image at 165.86 MB/s Jul 07 18:13:49 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 is being set with open permissions: ugo+rw Jul 07 18:13:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:49 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 Jul 07 18:13:49 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:50 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7" returned: 0 in 0.674s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Lock "cinder-quobyte-b713bb3c-6471-4daa-8026-5e99a19bbca7" released by "_copy_volume_from_snapshot" :: held 9.647s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Acquiring lock "cinder-quobyte-5af4b426-8f38-4a3f-b4ba-eebfd22154d2" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Lock "cinder-quobyte-5af4b426-8f38-4a3f-b4ba-eebfd22154d2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Deleting offline snapshot 5af4b426-8f38-4a3f-b4ba-eebfd22154d2 of volume c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:13:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] snapshot_file for this snap is: volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:13:50 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2889a3e-9cdb-4ac8-aedd-2d23a1cb4d83]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:50 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 Jul 07 18:13:50 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:51 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c286af96-48c0-4ed9-947e-c4444a8d6d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:13:51 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3973c8d7-7afe-40b0-8b08-110b04bd932b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:51 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 Jul 07 18:13:51 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:52 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83" returned: 0 in 0.840s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:52 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 Jul 07 18:13:52 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:52 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2" returned: 0 in 0.936s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:52 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2 Jul 07 18:13:52 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:53 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83.5af4b426-8f38-4a3f-b4ba-eebfd22154d2" returned: 0 in 0.766s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Lock "cinder-quobyte-5af4b426-8f38-4a3f-b4ba-eebfd22154d2" released by "_delete_snapshot" :: held 3.496s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.240s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.503s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ead185fa-27b5-4e20-a255-72b23e922c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b713bb3c-6471-4daa-8026-5e99a19bbca7', 'volume_size': 2, 'source_volid': 'c286af96-48c0-4ed9-947e-c4444a8d6d83', 'source_volstatus': 'available'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace75d41-e816-49d1-a055-0126adf829ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:13:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Volume volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 (b713bb3c-6471-4daa-8026-5e99a19bbca7): created successfully Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace75d41-e816-49d1-a055-0126adf829ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Flow 'volume_create_manager' (23a2ee4c-7ba3-454d-8d2c-d99ce00510d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8430f5fa-1219-4ff7-b640-e062ca385517]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c17944e8-cc8e-497e-b2c5-7e82b4232f02 tempest-VolumesCloneTest-608692371 None] Created volume successfully. Jul 07 18:13:54 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 Jul 07 18:13:54 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Acquiring lock "cinder-b713bb3c-6471-4daa-8026-5e99a19bbca7-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Lock "cinder-b713bb3c-6471-4daa-8026-5e99a19bbca7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Acquiring lock "cinder-quobyte-b713bb3c-6471-4daa-8026-5e99a19bbca7" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Lock "cinder-quobyte-b713bb3c-6471-4daa-8026-5e99a19bbca7" acquired by "delete_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded9da0-9702-4b87-8128-5c52975b253e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:54 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 Jul 07 18:13:54 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:54 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4" returned: 0 in 1.028s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:55 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 Jul 07 18:13:55 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:55 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7" returned: 0 in 0.894s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:55 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7 Jul 07 18:13:55 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:55 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4" returned: 1 in 0.789s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:13:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.875s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4309650-f368-4223-b827-5bd52e068b4f', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:13:55 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-37ba1cdb-3ddc-44e1-b3c1-df4c4486746b req-73523044-762e-48eb-a203-006208913d1d tempest-TestInstancesWithCinderVolumes-1055789454 None] attachment_update completed successfully. Jul 07 18:13:56 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b713bb3c-6471-4daa-8026-5e99a19bbca7" returned: 0 in 0.748s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Lock "cinder-quobyte-b713bb3c-6471-4daa-8026-5e99a19bbca7" released by "delete_volume" :: held 1.729s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Created reservations ['77db1121-3b21-4175-95ed-e8a220af239b', '012148a8-ed81-4c45-92f7-16d48b242385', 'f8c0409b-799f-4160-b523-7e410e880eaa', '44709a0b-dafe-4fdc-9077-971e4ec83260'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:56 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:13:56 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Acquiring lock "cinder-c286af96-48c0-4ed9-947e-c4444a8d6d83-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Lock "cinder-c286af96-48c0-4ed9-947e-c4444a8d6d83-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Acquiring lock "cinder-quobyte-c286af96-48c0-4ed9-947e-c4444a8d6d83" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Lock "cinder-quobyte-c286af96-48c0-4ed9-947e-c4444a8d6d83" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d40ec3-5d0b-41b8-87e6-5eccfdc7e54c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:13:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:57 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 Jul 07 18:13:57 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:57 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.757s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:57 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Deleted volume successfully. Jul 07 18:13:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4adaa9b3-8cb5-4c4c-8926-2536479707d1 tempest-VolumesCloneTest-608692371 None] Lock "cinder-b713bb3c-6471-4daa-8026-5e99a19bbca7-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:57 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83" returned: 0 in 0.867s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:57 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83 Jul 07 18:13:57 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:58 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c286af96-48c0-4ed9-947e-c4444a8d6d83" returned: 0 in 0.779s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Lock "cinder-quobyte-c286af96-48c0-4ed9-947e-c4444a8d6d83" released by "delete_volume" :: held 1.727s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:13:58 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Created reservations ['8f57c6af-a2a7-4cb2-82f5-ba4983028bb2', '8f436bc9-7a37-49b9-810d-81c826cd7824', 'd6ba79d0-ef70-4ccf-a72f-a143f447be0e', 'a40304b1-85a2-45cb-8bf2-969ee042e00a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:13:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:13:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:13:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:13:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:13:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:13:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:13:58 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:13:58 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:13:59 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Jul 07 18:13:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.915s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:13:59 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:13:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Deleted volume successfully. Jul 07 18:13:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-314b2f26-1690-4e71-afd3-7905414460f8 tempest-VolumesCloneTest-608692371 None] Lock "cinder-c286af96-48c0-4ed9-947e-c4444a8d6d83-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (2ad3b754-9e8b-41c7-9b56-878376cd3f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e0bea0-3280-4be4-ada0-7d0e66325625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e0bea0-3280-4be4-ada0-7d0e66325625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938227140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e04665c-1983-4b1e-9e2e-82bcae34d67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:03Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d6cbf5-b3ae-4c4b-8a27-01c04839dddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d6cbf5-b3ae-4c4b-8a27-01c04839dddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a69ed58-08ed-43dd-8919-fd5f58445f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a69ed58-08ed-43dd-8919-fd5f58445f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e04665c-1983-4b1e-9e2e-82bcae34d67e', 'volume_name': 'volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b177de-a581-45f6-81ad-660b76bf54cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b177de-a581-45f6-81ad-660b76bf54cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75dd5413-f789-4b15-93e2-b798c9746df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:03 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Volume 1e04665c-1983-4b1e-9e2e-82bcae34d67e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e', 'volume_size': 1} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1938227140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e04665c-1983-4b1e-9e2e-82bcae34d67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:03Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Creating volume 1e04665c-1983-4b1e-9e2e-82bcae34d67e {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:03 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:03 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e 1073741824 Jul 07 18:14:03 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (6d00730a-b2ff-4f86-86c9-647fe8441c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050b3f17-9139-466f-95db-295bc9a220eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050b3f17-9139-466f-95db-295bc9a220eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1331528951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c548bedd-8a0e-42a7-bd65-0ae2723346fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:04Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a36fb7-b432-4438-9b68-d83b63401b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a36fb7-b432-4438-9b68-d83b63401b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59face97-e42d-4f6c-982b-81667515391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59face97-e42d-4f6c-982b-81667515391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c548bedd-8a0e-42a7-bd65-0ae2723346fd', 'volume_name': 'volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5147ad-7a1f-4c65-b607-c700cb36441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5147ad-7a1f-4c65-b607-c700cb36441b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fddc8cf-c58f-4a21-a580-38a249f9ad72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Volume c548bedd-8a0e-42a7-bd65-0ae2723346fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd', 'volume_size': 1} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (d7f565b1-1eb9-4a93-b053-331a76068030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629d7741-34a5-4ada-966f-c6a0d3595238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (629d7741-34a5-4ada-966f-c6a0d3595238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2061000423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95941c4-dfbe-4642-825f-6f14a636f584,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:04Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187557cf-c5e3-49e7-867d-78beb6f74fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187557cf-c5e3-49e7-867d-78beb6f74fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca02257-6326-4fd0-b3e0-caedea7cf8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca02257-6326-4fd0-b3e0-caedea7cf8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c95941c4-dfbe-4642-825f-6f14a636f584', 'volume_name': 'volume-c95941c4-dfbe-4642-825f-6f14a636f584', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129fb157-9980-4c52-a4c5-bbac1d61d98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129fb157-9980-4c52-a4c5-bbac1d61d98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3cfc04-935d-4a34-b03d-9142fba223ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Volume c95941c4-dfbe-4642-825f-6f14a636f584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c95941c4-dfbe-4642-825f-6f14a636f584', 'volume_size': 1} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (20965fb4-a5bb-4d3a-9da2-5d2517643ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5f388f-2b82-4e18-bb70-5c46615fd40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a5f388f-2b82-4e18-bb70-5c46615fd40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139465699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7ddf77-8fb5-4938-8571-894131cae745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:05Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d83efd-e293-4bcf-8454-4c01d2c64d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d83efd-e293-4bcf-8454-4c01d2c64d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49ff9af-8f73-4677-a67a-8f958416d404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49ff9af-8f73-4677-a67a-8f958416d404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7ddf77-8fb5-4938-8571-894131cae745', 'volume_name': 'volume-bb7ddf77-8fb5-4938-8571-894131cae745', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700c0331-aad4-47e3-bd04-8964ba7921ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700c0331-aad4-47e3-bd04-8964ba7921ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:05 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4e9e20-115f-4e4d-b4f3-e9b5cb7a8a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:05 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Volume bb7ddf77-8fb5-4938-8571-894131cae745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7ddf77-8fb5-4938-8571-894131cae745', 'volume_size': 1} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e 1073741824" returned: 0 in 1.558s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:05 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e Jul 07 18:14:05 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (69daee21-e4d6-47e2-b0df-b5c8b93ce3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce561b7f-3251-4796-8b14-fa691b2504d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce561b7f-3251-4796-8b14-fa691b2504d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613299978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f901cc5c-c85a-4218-b342-0308b93f2d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:05Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73270a08-188f-4ec1-ae27-a9d6df746257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73270a08-188f-4ec1-ae27-a9d6df746257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a2e58b-b1a7-4dd8-8fdb-86ee687c1687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a2e58b-b1a7-4dd8-8fdb-86ee687c1687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f901cc5c-c85a-4218-b342-0308b93f2d9e', 'volume_name': 'volume-f901cc5c-c85a-4218-b342-0308b93f2d9e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a0eb9e-ea06-4039-bf37-65f5c90ab69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a0eb9e-ea06-4039-bf37-65f5c90ab69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf91c1b-f8c0-4946-b07c-af415f0d9568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:05 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Volume f901cc5c-c85a-4218-b342-0308b93f2d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f901cc5c-c85a-4218-b342-0308b93f2d9e', 'volume_size': 1} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (10ad1899-a115-452a-a713-85e1c17ed3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb75db4e-e9a9-4ba6-988c-cb0f124d1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb75db4e-e9a9-4ba6-988c-cb0f124d1178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-315771590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c27f7fed-be17-43a3-82d1-9e46f2af9253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:06Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94679766-bc25-4d4d-a6ca-fd96aeeca588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94679766-bc25-4d4d-a6ca-fd96aeeca588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a6b4dc-47fc-42ac-a7a8-5ae28ddac5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8a6b4dc-47fc-42ac-a7a8-5ae28ddac5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c27f7fed-be17-43a3-82d1-9e46f2af9253', 'volume_name': 'volume-c27f7fed-be17-43a3-82d1-9e46f2af9253', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983320d7-671f-4fcd-8966-f80f3f831710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983320d7-671f-4fcd-8966-f80f3f831710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3065d41f-4a8d-4371-9711-4459940300b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Volume c27f7fed-be17-43a3-82d1-9e46f2af9253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c27f7fed-be17-43a3-82d1-9e46f2af9253', 'volume_size': 1} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:06 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e" returned: 0 in 1.080s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] <== create_volume: return (2716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.724s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.780s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1331528951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c548bedd-8a0e-42a7-bd65-0ae2723346fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:04Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Creating volume c548bedd-8a0e-42a7-bd65-0ae2723346fd {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:06 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75dd5413-f789-4b15-93e2-b798c9746df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:06 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd 1073741824 Jul 07 18:14:06 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcca406f-2721-4aa9-84d6-734c78951771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Volume volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e (1e04665c-1983-4b1e-9e2e-82bcae34d67e): created successfully Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcca406f-2721-4aa9-84d6-734c78951771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (2ad3b754-9e8b-41c7-9b56-878376cd3f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3d3b19b4-fe6d-43f9-a1b4-3fd36df44487 tempest-CreateVolumesFromImageTest-241453324 None] Created volume successfully. Jul 07 18:14:07 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd 1073741824" returned: 0 in 1.109s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:07 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd Jul 07 18:14:07 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:08 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd" returned: 0 in 0.847s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.295s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2061000423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95941c4-dfbe-4642-825f-6f14a636f584,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:04Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Creating volume c95941c4-dfbe-4642-825f-6f14a636f584 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:08 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:08 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584 1073741824 Jul 07 18:14:08 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fddc8cf-c58f-4a21-a580-38a249f9ad72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c315f18e-febe-462c-a0a9-c6fa36c31a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:08 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Volume volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd (c548bedd-8a0e-42a7-bd65-0ae2723346fd): created successfully Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c315f18e-febe-462c-a0a9-c6fa36c31a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (6d00730a-b2ff-4f86-86c9-647fe8441c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fb40e00b-e93f-44fb-929c-ac35366d910e tempest-CreateVolumesFromImageTest-241453324 None] Created volume successfully. Jul 07 18:14:09 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584 1073741824" returned: 0 in 1.203s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:09 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584 Jul 07 18:14:09 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:10 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584" returned: 0 in 0.839s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.275s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1139465699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7ddf77-8fb5-4938-8571-894131cae745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:05Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Creating volume bb7ddf77-8fb5-4938-8571-894131cae745 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:10 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:10 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745 1073741824 Jul 07 18:14:10 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb3cfc04-935d-4a34-b03d-9142fba223ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95941c4-dfbe-4642-825f-6f14a636f584', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c6c75a-9179-4d89-9ea3-24e4f92c669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:10 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Volume volume-c95941c4-dfbe-4642-825f-6f14a636f584 (c95941c4-dfbe-4642-825f-6f14a636f584): created successfully Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c6c75a-9179-4d89-9ea3-24e4f92c669b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (d7f565b1-1eb9-4a93-b053-331a76068030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-634599d4-9458-4529-93cc-c675fd7922a7 tempest-VolumesGetTest-81576646 None] Created volume successfully. Jul 07 18:14:11 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745 1073741824" returned: 0 in 0.965s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:11 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745 Jul 07 18:14:11 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:12 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745" returned: 0 in 0.967s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.840s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613299978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f901cc5c-c85a-4218-b342-0308b93f2d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:05Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Creating volume f901cc5c-c85a-4218-b342-0308b93f2d9e {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:12 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:12 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e 1073741824 Jul 07 18:14:12 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e4e9e20-115f-4e4d-b4f3-e9b5cb7a8a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7ddf77-8fb5-4938-8571-894131cae745', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9541bc3-275e-4dc0-8eb1-792b48faa818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:12 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Volume volume-bb7ddf77-8fb5-4938-8571-894131cae745 (bb7ddf77-8fb5-4938-8571-894131cae745): created successfully Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9541bc3-275e-4dc0-8eb1-792b48faa818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (20965fb4-a5bb-4d3a-9da2-5d2517643ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:12 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dcc42ba4-e071-4a28-b6cb-286bcb5b27cb tempest-CreateVolumesFromImageTest-241453324 None] Created volume successfully. Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (8eb02648-543b-4c6e-ab37-e6fa237361d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df7f938-9e54-475d-a078-f90814874d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df7f938-9e54-475d-a078-f90814874d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-834748683',display_name='tempest-VolumesGetTest-Volume-794300111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:12Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5f6f66-fea7-48f2-ad72-838b68698195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5f6f66-fea7-48f2-ad72-838b68698195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4accd5-0241-466d-9da6-d4a915457139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4accd5-0241-466d-9da6-d4a915457139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293', 'volume_name': 'volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1740ab5c-a679-477e-92bd-3f2c194f8ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1740ab5c-a679-477e-92bd-3f2c194f8ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f3d467-9128-4d9a-9664-b5a83ee3216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:12 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Volume f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293', 'volume_size': 1} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:12 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:12 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:13 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e 1073741824" returned: 0 in 1.270s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:13 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.747s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:14:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:14:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:14:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:13 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e Jul 07 18:14:13 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:14 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e" returned: 0 in 0.713s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.333s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-315771590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c27f7fed-be17-43a3-82d1-9e46f2af9253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8f5e3a2f3445ddaa21a2ed106262a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:06Z,use_quota=True,user_id='1a60ac5fc5d3480182585831871340e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Creating volume c27f7fed-be17-43a3-82d1-9e46f2af9253 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:14 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:14 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 1073741824 Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf91c1b-f8c0-4946-b07c-af415f0d9568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f901cc5c-c85a-4218-b342-0308b93f2d9e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:14 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f6b3b4-0b94-439e-aab1-8ff4b76b9bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:14 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Volume volume-f901cc5c-c85a-4218-b342-0308b93f2d9e (f901cc5c-c85a-4218-b342-0308b93f2d9e): created successfully Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f6b3b4-0b94-439e-aab1-8ff4b76b9bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (69daee21-e4d6-47e2-b0df-b5c8b93ce3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:14 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-49ca8a54-2711-4d62-871b-ae2d84f87d7a tempest-CreateVolumesFromImageTest-241453324 None] Created volume successfully. Jul 07 18:14:15 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 1073741824" returned: 0 in 0.870s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:15 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 Jul 07 18:14:15 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:15 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253" returned: 0 in 0.677s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-834748683',display_name='tempest-VolumesGetTest-Volume-794300111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:12Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Creating volume f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:16 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3065d41f-4a8d-4371-9711-4459940300b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c27f7fed-be17-43a3-82d1-9e46f2af9253', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:16 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 1073741824 Jul 07 18:14:16 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8fcc00-99d1-4ce0-9047-bd438befe76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:16 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Volume volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 (c27f7fed-be17-43a3-82d1-9e46f2af9253): created successfully Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd8fcc00-99d1-4ce0-9047-bd438befe76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Flow 'volume_create_manager' (10ad1899-a115-452a-a713-85e1c17ed3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:16 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-711899ca-4f56-4b15-9dde-053f67bfd3bc tempest-CreateVolumesFromImageTest-241453324 None] Created volume successfully. Jul 07 18:14:16 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 1073741824" returned: 0 in 0.840s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:16 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 Jul 07 18:14:16 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-c27f7fed-be17-43a3-82d1-9e46f2af9253-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-c27f7fed-be17-43a3-82d1-9e46f2af9253-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-quobyte-c27f7fed-be17-43a3-82d1-9e46f2af9253" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-c27f7fed-be17-43a3-82d1-9e46f2af9253" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c511c1ec-c9fa-4459-909e-e468e35d11e1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:17 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 Jul 07 18:14:17 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:17 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293" returned: 0 in 0.747s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f3d467-9128-4d9a-9664-b5a83ee3216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59430f2-41aa-41cc-9cef-814144fa66c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:17 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Volume volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 (f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293): created successfully Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59430f2-41aa-41cc-9cef-814144fa66c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (8eb02648-543b-4c6e-ab37-e6fa237361d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-34346ebf-7fe8-4a93-a801-b5c52ad20abb tempest-VolumesGetTest-81576646 None] Created volume successfully. Jul 07 18:14:18 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253" returned: 0 in 1.099s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:18 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253 Jul 07 18:14:18 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Lock "cinder-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=78,cinder:INSERT=27,cinder:UPDATE=81,cinder:DELETE=7 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=99,cinder:SELECT=66,cinder:DELETE=11,cinder:INSERT=21 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-quobyte-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e7872c-44d0-4a29-b3c7-3d5f8eea03c4]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:19 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c27f7fed-be17-43a3-82d1-9e46f2af9253" returned: 0 in 0.813s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-c27f7fed-be17-43a3-82d1-9e46f2af9253" released by "delete_volume" :: held 1.961s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:19 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 Jul 07 18:14:19 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Created reservations ['0ac186fb-3659-48a4-85a6-0cf47ab4d143', '180d85a4-8154-40e5-bf97-6fa61fa18e50', '2db339fb-73fe-40d1-a31b-40da0282e5b1', 'af99d740-11b3-426d-b859-51b49abc7750'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:19 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:19 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-f901cc5c-c85a-4218-b342-0308b93f2d9e-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-f901cc5c-c85a-4218-b342-0308b93f2d9e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-quobyte-f901cc5c-c85a-4218-b342-0308b93f2d9e" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-f901cc5c-c85a-4218-b342-0308b93f2d9e" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd51c41-552a-4894-89e4-953e2092ed08]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:19 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e Jul 07 18:14:19 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:20 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293" returned: 0 in 0.813s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:20 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293 Jul 07 18:14:20 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:20 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.749s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Deleted volume successfully. Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d6f6bdc8-3141-4824-bc05-4ff932d3da4f tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-c27f7fed-be17-43a3-82d1-9e46f2af9253-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:20 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e" returned: 0 in 0.849s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:20 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e Jul 07 18:14:20 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:20 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293" returned: 0 in 0.690s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293" released by "delete_volume" :: held 1.559s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Created reservations ['f0e50aaa-5b41-4368-b9e7-153fa2aa5a43', '2bc8f736-665d-4ed7-a4d6-b7040728c4dd', '5bc1b6bb-406b-4f87-8a38-077d9fcf2cda', '5cbe5305-f605-4989-9006-2fc5b848eb7e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:20 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:20 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:21 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f901cc5c-c85a-4218-b342-0308b93f2d9e" returned: 0 in 0.651s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-f901cc5c-c85a-4218-b342-0308b93f2d9e" released by "delete_volume" :: held 1.550s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Created reservations ['a6166e7e-5f62-40b8-ab5b-80cd05b1d6b3', '7e81c628-4d18-4231-86e7-0ca9069298d9', 'b7742f7b-0288-4750-9527-567b7e70f676', '5a2d4506-6fb2-43dc-8474-243e831e5127'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:21 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-c95941c4-dfbe-4642-825f-6f14a636f584-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:21 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Lock "cinder-c95941c4-dfbe-4642-825f-6f14a636f584-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-quobyte-c95941c4-dfbe-4642-825f-6f14a636f584" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-c95941c4-dfbe-4642-825f-6f14a636f584" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b5a4cd-2bec-4e25-9b3e-7d4eb8e8b5c0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:21 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.699s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:21 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Deleted volume successfully. Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5ca1f6ad-d266-4eac-9f96-85673de63851 tempest-VolumesGetTest-81576646 None] Lock "cinder-f5d4f1b8-ea2e-42dd-8b75-dd1ac1d7a293-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:21 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584 Jul 07 18:14:21 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-bb7ddf77-8fb5-4938-8571-894131cae745-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-bb7ddf77-8fb5-4938-8571-894131cae745-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-quobyte-bb7ddf77-8fb5-4938-8571-894131cae745" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-bb7ddf77-8fb5-4938-8571-894131cae745" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f38a01c-a23c-42f4-b8d4-85d7723d4f9e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:22 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745 Jul 07 18:14:22 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:22 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.711s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:22 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:22 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Deleted volume successfully. Jul 07 18:14:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ff42cdc7-f350-4b87-b485-7be27fbe2a40 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-f901cc5c-c85a-4218-b342-0308b93f2d9e-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:22 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584" returned: 0 in 0.844s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:22 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584 Jul 07 18:14:22 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:22 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745" returned: 0 in 0.825s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:22 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745 Jul 07 18:14:22 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:23 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c95941c4-dfbe-4642-825f-6f14a636f584" returned: 0 in 0.765s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-c95941c4-dfbe-4642-825f-6f14a636f584" released by "delete_volume" :: held 1.661s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Created reservations ['2223ef6a-309a-41ee-8606-68b70937d6c9', 'e1604ce8-7d29-4fdd-af1d-2110e82f7666', '0bd13465-3890-4d86-b827-2e3c52b78410', '812adb6c-b601-4e96-9e34-561339ab50c2'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:23 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:23 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:23 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bb7ddf77-8fb5-4938-8571-894131cae745" returned: 0 in 0.697s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-bb7ddf77-8fb5-4938-8571-894131cae745" released by "delete_volume" :: held 1.567s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Created reservations ['b89e3483-a759-46df-b6ab-11ac8cca855d', '1fd66870-9ba3-4321-a06f-35e13baf0093', 'a467c834-99e5-455f-9c30-eaed57100f69', 'e310a8e4-af9b-4418-9021-f163af16630c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:23 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:23 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-c548bedd-8a0e-42a7-bd65-0ae2723346fd-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-c548bedd-8a0e-42a7-bd65-0ae2723346fd-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:24 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.034s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Deleted volume successfully. Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-quobyte-c548bedd-8a0e-42a7-bd65-0ae2723346fd" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-c548bedd-8a0e-42a7-bd65-0ae2723346fd" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3a3bdd4c-c21a-4e65-b368-acd04841860b tempest-VolumesGetTest-81576646 None] Lock "cinder-c95941c4-dfbe-4642-825f-6f14a636f584-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f481806-a861-414a-97d2-518672ee532c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (768a798e-b43d-4096-9644-4fa3dce7bd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7365fb54-c550-48cb-af57-c03ad32a429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:24 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd Jul 07 18:14:24 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7365fb54-c550-48cb-af57-c03ad32a429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-83569970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305ab668-c142-4efa-8505-7d1a59b2694e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:24Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3527f860-9d91-4f91-a9a2-da6b71e00c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3527f860-9d91-4f91-a9a2-da6b71e00c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbba765b-d589-4ce4-ac22-48869088d540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbba765b-d589-4ce4-ac22-48869088d540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305ab668-c142-4efa-8505-7d1a59b2694e', 'volume_name': 'volume-305ab668-c142-4efa-8505-7d1a59b2694e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef323045-3d5c-419e-90ab-38af9b92d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef323045-3d5c-419e-90ab-38af9b92d99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f9705e-d0c8-43e2-ac98-b54423e90725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:24 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Volume 305ab668-c142-4efa-8505-7d1a59b2694e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305ab668-c142-4efa-8505-7d1a59b2694e', 'volume_size': 1} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-83569970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=305ab668-c142-4efa-8505-7d1a59b2694e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:24Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Creating volume 305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:24 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:24 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e 1073741824 Jul 07 18:14:24 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:24 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.083s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Deleted volume successfully. Jul 07 18:14:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-60be8013-66d6-4bd2-b721-b5d0dfe07461 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-bb7ddf77-8fb5-4938-8571-894131cae745-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:25 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd" returned: 0 in 0.873s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:25 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd Jul 07 18:14:25 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:25 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e 1073741824" returned: 0 in 0.963s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:25 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e Jul 07 18:14:25 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:25 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c548bedd-8a0e-42a7-bd65-0ae2723346fd" returned: 0 in 0.688s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-c548bedd-8a0e-42a7-bd65-0ae2723346fd" released by "delete_volume" :: held 1.621s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Created reservations ['499595dc-aa49-4def-a229-7deeb205e223', 'a2aaeb26-785d-46af-a796-6d210fbf905a', '9077463d-4966-4c99-b4a1-1c93cfcdfad4', '88d8c492-794f-4fc3-a490-f6be89e38135'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:26 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:26 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:26 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f9705e-d0c8-43e2-ac98-b54423e90725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305ab668-c142-4efa-8505-7d1a59b2694e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cf0330-ce05-4c66-9be1-99988bbab11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:26 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Volume volume-305ab668-c142-4efa-8505-7d1a59b2694e (305ab668-c142-4efa-8505-7d1a59b2694e): created successfully Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cf0330-ce05-4c66-9be1-99988bbab11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (768a798e-b43d-4096-9644-4fa3dce7bd61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-aeb662d0-7f7a-420d-b0ac-040346d0710e tempest-VolumesGetTest-81576646 None] Created volume successfully. Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-1e04665c-1983-4b1e-9e2e-82bcae34d67e-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-1e04665c-1983-4b1e-9e2e-82bcae34d67e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "cinder-quobyte-1e04665c-1983-4b1e-9e2e-82bcae34d67e" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-1e04665c-1983-4b1e-9e2e-82bcae34d67e" acquired by "delete_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb133f-ebce-4e44-bfdd-ef94ddefea66]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:26 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e Jul 07 18:14:26 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:26 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.767s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Deleted volume successfully. Jul 07 18:14:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6dae3ca6-fd3b-4c96-bd7b-e6ba4e384b42 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-c548bedd-8a0e-42a7-bd65-0ae2723346fd-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:27 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e" returned: 0 in 0.739s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:27 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e Jul 07 18:14:27 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:28 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1e04665c-1983-4b1e-9e2e-82bcae34d67e" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-quobyte-1e04665c-1983-4b1e-9e2e-82bcae34d67e" released by "delete_volume" :: held 1.526s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Created reservations ['59d504b3-a734-4808-be34-40963701f655', '5fd77dba-edbb-41df-83fa-9fca7ea4a2eb', '530cd458-ac24-48e0-9a77-0b519d829850', '3f633759-5544-4354-9827-5f64a8568eb3'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:28 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:28 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (2771e017-8f51-40e6-9cc0-6388cde7edda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776a5316-2466-4119-b57d-d5537df7fa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776a5316-2466-4119-b57d-d5537df7fa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-939730562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abc7a91b-c0c2-4a44-8af2-1b57b9034f5d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=305ab668-c142-4efa-8505-7d1a59b2694e,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:28Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86b7c7c-9d12-4f89-a023-a9fd99229ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86b7c7c-9d12-4f89-a023-a9fd99229ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098dcf20-0ecd-4926-a267-5ee02896c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098dcf20-0ecd-4926-a267-5ee02896c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'abc7a91b-c0c2-4a44-8af2-1b57b9034f5d', 'volume_name': 'volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d', 'volume_size': 1, 'source_volid': '305ab668-c142-4efa-8505-7d1a59b2694e', 'source_volstatus': 'available'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b112e9e7-561e-4f30-8485-4f237910e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b112e9e7-561e-4f30-8485-4f237910e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacfc205-dba5-4dbd-8b93-2192e630f899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:28 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Volume abc7a91b-c0c2-4a44-8af2-1b57b9034f5d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d', 'volume_size': 1, 'source_volid': '305ab668-c142-4efa-8505-7d1a59b2694e', 'source_volstatus': 'available'} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:28 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Cloning volume 305ab668-c142-4efa-8505-7d1a59b2694e to volume abc7a91b-c0c2-4a44-8af2-1b57b9034f5d Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Creating offline snapshot 2f018e49-a69e-43ab-b872-fbe1442044d5 of volume 305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8617472a-3604-487b-87ef-02cd2704a5d2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:28 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e Jul 07 18:14:28 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:28 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.662s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:28 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Deleted volume successfully. Jul 07 18:14:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fee4a64d-fdf2-4b34-83c3-255bb3aeef49 tempest-CreateVolumesFromImageTest-241453324 None] Lock "cinder-1e04665c-1983-4b1e-9e2e-82bcae34d67e-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:29 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e" returned: 0 in 0.879s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:29 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 1G Jul 07 18:14:29 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:30 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 1G" returned: 0 in 0.922s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305ab668-c142-4efa-8505-7d1a59b2694e -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:30 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305ab668-c142-4efa-8505-7d1a59b2694e -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 Jul 07 18:14:30 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:31 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305ab668-c142-4efa-8505-7d1a59b2694e -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5" returned: 0 in 0.751s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:31 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 is being set with open permissions: ugo+rw Jul 07 18:14:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:31 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 Jul 07 18:14:31 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:31 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5" returned: 0 in 0.732s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:31 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.info Jul 07 18:14:31 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Flow 'volume_create_manager' (4fe75487-a9f9-483c-8b75-2bafc5480276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e977eca8-1437-4c13-8ef4-5085a2f15688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e977eca8-1437-4c13-8ef4-5085a2f15688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-675446832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554d2560-e293-4dfd-90a0-f3d782c340d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af83d05831d8416fb5b8387979410860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:32Z,use_quota=True,user_id='b61ecddfccae4e74910a1026fc14aae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b7c0bc-511f-4c67-bfaf-b0a57324cd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b7c0bc-511f-4c67-bfaf-b0a57324cd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c318ca-35f9-49e3-9cae-3bbe06b2cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c318ca-35f9-49e3-9cae-3bbe06b2cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554d2560-e293-4dfd-90a0-f3d782c340d3', 'volume_name': 'volume-554d2560-e293-4dfd-90a0-f3d782c340d3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5574cf77-3f43-4968-9c3b-eec2d3717a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5574cf77-3f43-4968-9c3b-eec2d3717a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7daafe-e9d4-4116-b4e6-b509a85f4fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:32 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Volume 554d2560-e293-4dfd-90a0-f3d782c340d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554d2560-e293-4dfd-90a0-f3d782c340d3', 'volume_size': 1} Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:32 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.info" returned: 0 in 0.678s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:32 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.info is being set with open permissions: ugo+rw Jul 07 18:14:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:32 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.info Jul 07 18:14:32 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:33 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.info" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-quobyte-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] snapshot: 2f018e49-a69e-43ab-b872-fbe1442044d5, volume: abc7a91b-c0c2-4a44-8af2-1b57b9034f5d, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[91029f00-92cf-453e-a52f-f9b99c9953a8]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:33 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 Jul 07 18:14:33 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:34 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5" returned: 0 in 0.794s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-305ab668-c142-4efa-8505-7d1a59b2694e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc1b1f0-d353-44d9-a9ef-9f1533c3ac3c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:34 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e Jul 07 18:14:34 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:34 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:34 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d Jul 07 18:14:34 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-6bdddd68-0c4d-49aa-b77b-8b359c08b681 req-528e5b98-dc7b-4de8-957c-bd13cbe4227b tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:39 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" returned: 0 in 4.514s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:39 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[db783364-80a8-408f-80ec-dbb84df676eb]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:39 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e Jul 07 18:14:39 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:40 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e" returned: 0 in 0.914s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:40 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:14:40 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Converted 1024.00 MB image at 226.82 MB/s Jul 07 18:14:40 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d is being set with open permissions: ugo+rw Jul 07 18:14:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:40 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d Jul 07 18:14:40 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:40 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" returned: 0 in 0.643s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" released by "_copy_volume_from_snapshot" :: held 7.799s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-quobyte-2f018e49-a69e-43ab-b872-fbe1442044d5" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-2f018e49-a69e-43ab-b872-fbe1442044d5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Deleting offline snapshot 2f018e49-a69e-43ab-b872-fbe1442044d5 of volume 305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] snapshot_file for this snap is: volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[08505160-4093-44fc-8a2f-af53334ed00f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:41 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 Jul 07 18:14:41 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:41 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5" returned: 0 in 0.784s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-305ab668-c142-4efa-8505-7d1a59b2694e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b43a04-15a9-41c8-a4bf-810eb21388e3]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:41 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e Jul 07 18:14:41 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:42 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e" returned: 0 in 0.736s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:42 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 Jul 07 18:14:42 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:43 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5" returned: 0 in 0.741s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:43 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5 Jul 07 18:14:43 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:43 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e.2f018e49-a69e-43ab-b872-fbe1442044d5" returned: 0 in 0.622s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-2f018e49-a69e-43ab-b872-fbe1442044d5" released by "_delete_snapshot" :: held 2.974s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.605s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.876s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-675446832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554d2560-e293-4dfd-90a0-f3d782c340d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af83d05831d8416fb5b8387979410860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:32Z,use_quota=True,user_id='b61ecddfccae4e74910a1026fc14aae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Creating volume 554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:44 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:44 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 1073741824 Jul 07 18:14:44 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cacfc205-dba5-4dbd-8b93-2192e630f899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d', 'volume_size': 1, 'source_volid': '305ab668-c142-4efa-8505-7d1a59b2694e', 'source_volstatus': 'available'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a06c0a-d815-4c06-9456-1a9ff4fc266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:44 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Volume volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d (abc7a91b-c0c2-4a44-8af2-1b57b9034f5d): created successfully Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a06c0a-d815-4c06-9456-1a9ff4fc266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (2771e017-8f51-40e6-9cc0-6388cde7edda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-465f2690-c6cd-4507-9854-edb243cd4cfc tempest-VolumesGetTest-81576646 None] Created volume successfully. Jul 07 18:14:44 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 1073741824" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:44 devstack sudo[100025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 Jul 07 18:14:44 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (46524134-e020-48a2-8ceb-264a1757f012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b55c85-fd22-4e89-8a6f-6271a9b05005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b55c85-fd22-4e89-8a6f-6271a9b05005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-609512063',display_name='tempest-VolumesGetTest-Volume-1161015301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6e8191-327d-4908-9081-3f5f2c1d69ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:45Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098306d6-ab63-4845-9c0d-3d64481c57a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098306d6-ab63-4845-9c0d-3d64481c57a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12636f53-d912-4d3a-81af-ba38189d2637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12636f53-d912-4d3a-81af-ba38189d2637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f6e8191-327d-4908-9081-3f5f2c1d69ee', 'volume_name': 'volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90fbc30-07b7-438b-9fa1-02fedb9c61c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a90fbc30-07b7-438b-9fa1-02fedb9c61c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476fce4b-6c0f-4f82-bccd-3904cab002e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Volume 3f6e8191-327d-4908-9081-3f5f2c1d69ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee', 'volume_size': 1} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:45 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3" returned: 0 in 0.665s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-6bdddd68-0c4d-49aa-b77b-8b359c08b681 req-528e5b98-dc7b-4de8-957c-bd13cbe4227b tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.665s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d41d80-e60b-4149-acb2-f5029dd44894]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-6bdddd68-0c4d-49aa-b77b-8b359c08b681 req-528e5b98-dc7b-4de8-957c-bd13cbe4227b tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7daafe-e9d4-4116-b4e6-b509a85f4fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554d2560-e293-4dfd-90a0-f3d782c340d3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39844a73-ce8c-4a9f-8fc8-40f0b2daedb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:45 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Volume volume-554d2560-e293-4dfd-90a0-f3d782c340d3 (554d2560-e293-4dfd-90a0-f3d782c340d3): created successfully Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39844a73-ce8c-4a9f-8fc8-40f0b2daedb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Flow 'volume_create_manager' (4fe75487-a9f9-483c-8b75-2bafc5480276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:45 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a6c7241c-a251-4592-b056-bdcd4ce9dd88 tempest-VolumeDependencyTests-44143413 None] Created volume successfully. Jul 07 18:14:45 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 Jul 07 18:14:45 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:46 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-6bdddd68-0c4d-49aa-b77b-8b359c08b681 req-528e5b98-dc7b-4de8-957c-bd13cbe4227b tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20" returned: 0 in 0.814s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-6bdddd68-0c4d-49aa-b77b-8b359c08b681 req-528e5b98-dc7b-4de8-957c-bd13cbe4227b tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-609512063',display_name='tempest-VolumesGetTest-Volume-1161015301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6e8191-327d-4908-9081-3f5f2c1d69ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:45Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Creating volume 3f6e8191-327d-4908-9081-3f5f2c1d69ee {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:46 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:46 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee 1073741824 Jul 07 18:14:46 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-6bdddd68-0c4d-49aa-b77b-8b359c08b681 req-528e5b98-dc7b-4de8-957c-bd13cbe4227b tempest-TestInstancesWithCinderVolumes-1055789454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-3b1e3623-fe92-4bec-95e7-40433e50ee20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '405b1b93-90e9-4650-bef7-409a303dca51', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:14:46 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-6bdddd68-0c4d-49aa-b77b-8b359c08b681 req-528e5b98-dc7b-4de8-957c-bd13cbe4227b tempest-TestInstancesWithCinderVolumes-1055789454 None] attachment_update completed successfully. Jul 07 18:14:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:47 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee 1073741824" returned: 0 in 0.864s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:47 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee Jul 07 18:14:47 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:48 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee" returned: 0 in 0.702s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.395s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Creating offline snapshot 0d64c1d0-91fe-4dcd-aea3-2604bc799f29 of volume 554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476fce4b-6c0f-4f82-bccd-3904cab002e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bb8455-e74d-4fa8-8dbe-65184d34ca66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cb681a-cc14-4e1a-b0a6-ced40fa78c65]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:48 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Volume volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee (3f6e8191-327d-4908-9081-3f5f2c1d69ee): created successfully Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bb8455-e74d-4fa8-8dbe-65184d34ca66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (46524134-e020-48a2-8ceb-264a1757f012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:48 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9420ec62-50dd-4d24-b20b-337aeaa8acdd tempest-VolumesGetTest-81576646 None] Created volume successfully. Jul 07 18:14:48 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 Jul 07 18:14:48 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-3f6e8191-327d-4908-9081-3f5f2c1d69ee-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Lock "cinder-3f6e8191-327d-4908-9081-3f5f2c1d69ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-quobyte-3f6e8191-327d-4908-9081-3f5f2c1d69ee" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-3f6e8191-327d-4908-9081-3f5f2c1d69ee" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94932df-922c-4d3a-90a7-60be093e1628]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:48 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3" returned: 0 in 0.826s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:48 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee Jul 07 18:14:48 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:48 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 1G Jul 07 18:14:48 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:49 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee" returned: 0 in 0.782s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:49 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee Jul 07 18:14:49 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:49 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 1G" returned: 0 in 0.818s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554d2560-e293-4dfd-90a0-f3d782c340d3 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:49 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554d2560-e293-4dfd-90a0-f3d782c340d3 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 Jul 07 18:14:49 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:50 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3f6e8191-327d-4908-9081-3f5f2c1d69ee" returned: 0 in 0.755s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-3f6e8191-327d-4908-9081-3f5f2c1d69ee" released by "delete_volume" :: held 1.577s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Created reservations ['2bef3af1-ccfd-4f8b-8484-061d542eb104', '356891d4-491e-4980-a320-1133910006f0', 'dd5809ce-8c47-4193-852d-9a2118257d2d', 'c2d36f02-370c-43d6-a338-164c34c0c48a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:50 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-554d2560-e293-4dfd-90a0-f3d782c340d3 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:50 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 is being set with open permissions: ugo+rw Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:50 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 Jul 07 18:14:50 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:50 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:50 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Lock "cinder-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-quobyte-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e5ce1f-6cf9-4d16-9aac-857205fe2ff5]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:51 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29" returned: 0 in 0.743s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:51 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.724s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Deleted volume successfully. Jul 07 18:14:51 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.info Jul 07 18:14:51 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4cf9f7f6-308e-46fa-997b-1e2201033d19 tempest-VolumesGetTest-81576646 None] Lock "cinder-3f6e8191-327d-4908-9081-3f5f2c1d69ee-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:51 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d Jul 07 18:14:51 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:52 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.info" returned: 0 in 0.719s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:52 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.info is being set with open permissions: ugo+rw Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:52 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" returned: 0 in 0.840s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:52 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.info Jul 07 18:14:52 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:52 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d Jul 07 18:14:52 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:52 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" returned: 0 in 0.643s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d" released by "delete_volume" :: held 1.528s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:52 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.info" returned: 0 in 0.681s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.631s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5a802eac-f83d-4cb2-8940-ddd936969325 tempest-VolumeDependencyTests-44143413 None] Create snapshot completed successfully Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Created reservations ['5b65bbf5-ca6e-4c41-b902-5ab1a64e398f', '5f533019-a905-4cc6-853f-a12457f96275', 'cf4f67c6-b092-445a-86da-b644f21b4aa3', 'db962a76-d724-4421-869c-8e8b9608f96c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:52 devstack sudo[100102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:52 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-305ab668-c142-4efa-8505-7d1a59b2694e-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Lock "cinder-305ab668-c142-4efa-8505-7d1a59b2694e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-quobyte-305ab668-c142-4efa-8505-7d1a59b2694e" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-305ab668-c142-4efa-8505-7d1a59b2694e" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:53 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dcb6a2-3737-4ded-abcf-687e009b0419]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.752s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Deleted volume successfully. Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Flow 'volume_create_manager' (b2191eef-4962-4596-a1dc-5fc6133e2ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f643b5-e60e-4b9b-ac17-490a5447c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48f643b5-e60e-4b9b-ac17-490a5447c562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2093354830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b138a3e-14b1-40a8-b9db-75d2bf3c8f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af83d05831d8416fb5b8387979410860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d64c1d0-91fe-4dcd-aea3-2604bc799f29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:54Z,use_quota=True,user_id='b61ecddfccae4e74910a1026fc14aae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae53aa9d-2a8b-464b-ba80-4814c7b35515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae53aa9d-2a8b-464b-ba80-4814c7b35515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab1af18-f345-456f-9743-54950979f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab1af18-f345-456f-9743-54950979f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b138a3e-14b1-40a8-b9db-75d2bf3c8f42', 'volume_name': 'volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42', 'volume_size': 1, 'snapshot_id': '0d64c1d0-91fe-4dcd-aea3-2604bc799f29'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3135a7a-0819-4f00-9f94-eb58e4d80453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3135a7a-0819-4f00-9f94-eb58e4d80453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb32ff3-93cb-429e-a1f8-40abd866c89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Volume 8b138a3e-14b1-40a8-b9db-75d2bf3c8f42: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42', 'volume_size': 1, 'snapshot_id': '0d64c1d0-91fe-4dcd-aea3-2604bc799f29'} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b15ae732-27a3-47f6-be60-d369eecdb51c tempest-VolumesGetTest-81576646 None] Lock "cinder-abc7a91b-c0c2-4a44-8af2-1b57b9034f5d-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:53 devstack sudo[100105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e Jul 07 18:14:53 devstack sudo[100105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "cinder-quobyte-0d64c1d0-91fe-4dcd-aea3-2604bc799f29-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" by "_create_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-0d64c1d0-91fe-4dcd-aea3-2604bc799f29-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Creating volume 8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 from snapshot 0d64c1d0-91fe-4dcd-aea3-2604bc799f29 {{(pid=86972) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "cinder-quobyte-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] snapshot: 0d64c1d0-91fe-4dcd-aea3-2604bc799f29, volume: 8b138a3e-14b1-40a8-b9db-75d2bf3c8f42, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f07cfd8-bed4-43b2-98dc-24288daa915e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:53 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 Jul 07 18:14:53 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:54 devstack sudo[100105]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e" returned: 0 in 0.952s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:54 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e Jul 07 18:14:54 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:54 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29" returned: 0 in 0.886s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-554d2560-e293-4dfd-90a0-f3d782c340d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:14:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:14:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:14:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[724729f4-d78d-4cc5-a5e5-c4d782bb5dfc]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:54 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 Jul 07 18:14:54 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-5cbf0a92-9c57-4dc8-98e7-4c325b6bc867 req-de438532-8fd3-4991-a20c-fff49875bcc3 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:55 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-305ab668-c142-4efa-8505-7d1a59b2694e" returned: 0 in 0.794s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-305ab668-c142-4efa-8505-7d1a59b2694e" released by "delete_volume" :: held 1.833s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Created reservations ['9b74b948-175a-41f9-8614-f0dd56415175', '26e0c43d-9864-4fc2-b9ab-fb53e46dd9e9', 'b43974ee-f51a-4255-8f91-74e567e94fc6', '2437c52e-c2af-4277-b17b-f03627b13c79'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:55 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3" returned: 0 in 0.850s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:14:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:55 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:14:55 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:55 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 Jul 07 18:14:55 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:14:56 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.759s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:14:56 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Deleted volume successfully. Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-83ac4d87-ff24-4c93-a31c-4f2ddf6dbb9f tempest-VolumesGetTest-81576646 None] Lock "cinder-305ab668-c142-4efa-8505-7d1a59b2694e-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (81b86333-782a-4b15-8af9-45a1c732c89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b162771d-eaf8-4b98-b78e-6fd1b4213913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b162771d-eaf8-4b98-b78e-6fd1b4213913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-623745063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22db3c07-68d1-47a2-9a0d-f0c662621f3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:56Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac068c72-4eb3-4235-8d92-6707dc676898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac068c72-4eb3-4235-8d92-6707dc676898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613909e9-9016-480b-bbe5-56c2a975179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:56 devstack cinder-volume[86972]: DEBUG cinder.image.glance [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Creating Keystone auth plugin from conf {{(pid=86972) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:14:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613909e9-9016-480b-bbe5-56c2a975179b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22db3c07-68d1-47a2-9a0d-f0c662621f3f', 'volume_name': 'volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612a1c01-3f39-4d6a-a84b-9a2642cb6cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612a1c01-3f39-4d6a-a84b-9a2642cb6cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:14:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2d9e5a-fa75-4302-b0cd-e471a655f60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:14:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Volume 22db3c07-68d1-47a2-9a0d-f0c662621f3f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 18:14:57 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Trying to clone 22db3c07-68d1-47a2-9a0d-f0c662621f3f from image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]). {{(pid=86972) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 18:14:58 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:14:58 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Image download 20.69 MB at 20.69 MB/s Jul 07 18:14:58 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f8905-f517-475e-b13a-2f6121fad89a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:14:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:14:59 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD Jul 07 18:14:59 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:00 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD" returned: 0 in 1.240s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:00 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Temporary image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 is fetched for user e97584512a2d4bfe9f336b23da705ba7. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:15:00 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b814ec-bf00-4f40-88ae-ddbc407e2dd9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:00 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD Jul 07 18:15:00 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:01 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" returned: 0 in 5.547s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7c4626-869e-4de4-8f91-5b2317462a5c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:01 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 Jul 07 18:15:01 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:01 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD" returned: 0 in 1.004s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:02 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3" returned: 0 in 1.007s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:15:02 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Converted 1024.00 MB image at 184.56 MB/s Jul 07 18:15:02 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 is being set with open permissions: ugo+rw Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:02 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 Jul 07 18:15:02 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:02 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" returned: 0 in 0.720s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" released by "_copy_volume_from_snapshot" :: held 9.117s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-0d64c1d0-91fe-4dcd-aea3-2604bc799f29-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" released by "_create_volume_from_snapshot" :: held 9.148s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.165s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-5cbf0a92-9c57-4dc8-98e7-4c325b6bc867 req-de438532-8fd3-4991-a20c-fff49875bcc3 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.923s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7436bcd-3bd8-41e8-9be8-4d17f15e08c6]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-5cbf0a92-9c57-4dc8-98e7-4c325b6bc867 req-de438532-8fd3-4991-a20c-fff49875bcc3 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb32ff3-93cb-429e-a1f8-40abd866c89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42', 'volume_size': 1, 'snapshot_id': '0d64c1d0-91fe-4dcd-aea3-2604bc799f29'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974fa6a4-b2da-436a-b824-1f4bd5d89266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:02 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Volume volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 (8b138a3e-14b1-40a8-b9db-75d2bf3c8f42): created successfully Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974fa6a4-b2da-436a-b824-1f4bd5d89266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Flow 'volume_create_manager' (b2191eef-4962-4596-a1dc-5fc6133e2ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:02 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-230ef538-e3fe-4618-88b6-96010ce89065 tempest-VolumeDependencyTests-44143413 None] Created volume successfully. Jul 07 18:15:03 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 Jul 07 18:15:03 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Acquiring lock "cinder-0d64c1d0-91fe-4dcd-aea3-2604bc799f29-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Lock "cinder-0d64c1d0-91fe-4dcd-aea3-2604bc799f29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Acquiring lock "cinder-quobyte-554d2560-e293-4dfd-90a0-f3d782c340d3" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:03 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-5cbf0a92-9c57-4dc8-98e7-4c325b6bc867 req-de438532-8fd3-4991-a20c-fff49875bcc3 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627" returned: 0 in 0.799s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-5cbf0a92-9c57-4dc8-98e7-4c325b6bc867 req-de438532-8fd3-4991-a20c-fff49875bcc3 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.820s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-623745063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22db3c07-68d1-47a2-9a0d-f0c662621f3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:14:56Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Creating volume 22db3c07-68d1-47a2-9a0d-f0c662621f3f {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:03 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-554d2560-e293-4dfd-90a0-f3d782c340d3" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Acquiring lock "cinder-quobyte-0d64c1d0-91fe-4dcd-aea3-2604bc799f29" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:03 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f 1073741824 Jul 07 18:15:03 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-0d64c1d0-91fe-4dcd-aea3-2604bc799f29" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Deleting offline snapshot 0d64c1d0-91fe-4dcd-aea3-2604bc799f29 of volume 554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] snapshot_file for this snap is: volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-5cbf0a92-9c57-4dc8-98e7-4c325b6bc867 req-de438532-8fd3-4991-a20c-fff49875bcc3 tempest-TestInstancesWithCinderVolumes-1055789454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3910507-03b7-41a1-b6d0-56edcfb8470f', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d72ab61-99dc-46bc-afa5-4c29fd9a3b57]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-5cbf0a92-9c57-4dc8-98e7-4c325b6bc867 req-de438532-8fd3-4991-a20c-fff49875bcc3 tempest-TestInstancesWithCinderVolumes-1055789454 None] attachment_update completed successfully. Jul 07 18:15:03 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 Jul 07 18:15:03 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:04 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f 1073741824" returned: 0 in 0.944s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:04 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29" returned: 0 in 0.875s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-554d2560-e293-4dfd-90a0-f3d782c340d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:15:04 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ead278-8125-48f8-b707-145e408c3a12]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:04 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f Jul 07 18:15:04 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:04 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 Jul 07 18:15:04 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:05 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f" returned: 0 in 0.719s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:05 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Attempting download of 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}])) to volume 22db3c07-68d1-47a2-9a0d-f0c662621f3f. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:15:05 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3" returned: 0 in 0.793s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:05 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 Jul 07 18:15:05 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:05 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a4e86c-df92-46b6-abe8-ca878b571cb4]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ei2u96gz {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:05 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ei2u96gz Jul 07 18:15:05 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:06 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29" returned: 0 in 0.751s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:06 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29 Jul 07 18:15:06 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:06 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ei2u96gz" returned: 0 in 0.772s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ei2u96gz {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:06 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ei2u96gz Jul 07 18:15:06 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:06 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3.0d64c1d0-91fe-4dcd-aea3-2604bc799f29" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-0d64c1d0-91fe-4dcd-aea3-2604bc799f29" released by "_delete_snapshot" :: held 3.236s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-554d2560-e293-4dfd-90a0-f3d782c340d3" released by "delete_snapshot" :: held 3.268s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Created reservations ['aca8fcc2-7666-4048-9dda-e45f16a3fcd8', '33ab8687-22fe-486e-bb88-6347a26aef60', 'c1f1d20f-2443-4934-b5a4-4ea6ab1796fd', '16c0ca28-b601-4f33-8bf6-ae9e393e034f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:07 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ei2u96gz" returned: 1 in 0.783s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_ei2u96gz' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d0a177-da9b-4fd4-bf8e-857cfdbee303]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Delete snapshot completed successfully. Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6495e6f6-befc-4c1e-a9f9-aba76bb9149d tempest-VolumeDependencyTests-44143413 None] Lock "cinder-0d64c1d0-91fe-4dcd-aea3-2604bc799f29-delete_snapshot" released by "delete_snapshot" :: held 3.472s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:07 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD Jul 07 18:15:07 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:07 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 was qcow2, converting to raw {{(pid=86972) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:07 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f Jul 07 18:15:07 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Acquiring lock "cinder-554d2560-e293-4dfd-90a0-f3d782c340d3-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Lock "cinder-554d2560-e293-4dfd-90a0-f3d782c340d3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Acquiring lock "cinder-quobyte-554d2560-e293-4dfd-90a0-f3d782c340d3" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-554d2560-e293-4dfd-90a0-f3d782c340d3" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ae5d1a-f78a-44c6-93f5-ab4b2ae9f956]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:08 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 Jul 07 18:15:08 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:08 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3" returned: 0 in 0.876s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:09 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3 Jul 07 18:15:09 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:09 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-554d2560-e293-4dfd-90a0-f3d782c340d3" returned: 0 in 0.805s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-554d2560-e293-4dfd-90a0-f3d782c340d3" released by "delete_volume" :: held 1.753s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:09 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Created reservations ['811c57ac-5322-4138-b4a1-6a736d3b0596', 'c955bd29-51df-43cf-aa6b-f8b7f35440fd', 'd34c1c71-53e2-4191-a72d-75808f67370f', '2fb10341-687f-4189-9354-b86df047d378'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:10 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f" returned: 0 in 2.150s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_vh8o3yc9devstack@QuobyteHD, size 112.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:15:10 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Converted 112.00 MB image at 52.05 MB/s Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:10 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:10 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:10 devstack sudo[100246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f 1G Jul 07 18:15:10 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "cinder-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Lock "cinder-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "cinder-quobyte-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de4e577-d82b-416e-9b22-8e27df5be83c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:10 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 Jul 07 18:15:10 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:10 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.808s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Deleted volume successfully. Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3210ac90-8b70-4f5e-b27d-edb490759fda tempest-VolumeDependencyTests-44143413 None] Lock "cinder-554d2560-e293-4dfd-90a0-f3d782c340d3-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:10 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f 1G" returned: 0 in 0.900s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a912b8d-17bf-4f43-94ad-8fb4ba576a19]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:11 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f Jul 07 18:15:11 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:11 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" returned: 0 in 0.890s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:11 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42 Jul 07 18:15:11 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:11 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f" returned: 0 in 0.955s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:12 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f Jul 07 18:15:12 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:12 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" returned: 0 in 0.847s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Lock "cinder-quobyte-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42" released by "delete_volume" :: held 1.804s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Created reservations ['00ba074d-6de6-426a-99ee-f3e2ec04790b', 'd6b6a224-cc81-4845-84c6-bb5341ef0793', '2ca3d47c-90ae-43cd-a992-048b5fd7b915', '102a0118-fd36-467d-ae96-728e39da462a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:12 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:12 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:12 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f" returned: 1 in 0.809s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Downloaded image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}])) to volume 22db3c07-68d1-47a2-9a0d-f0c662621f3f successfully. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Temporary image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 for user e97584512a2d4bfe9f336b23da705ba7 is deleted. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Marking volume 22db3c07-68d1-47a2-9a0d-f0c662621f3f as bootable. {{(pid=86972) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Copying metadata from image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 to 22db3c07-68d1-47a2-9a0d-f0c662621f3f. {{(pid=86972) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Creating volume glance metadata for volume 22db3c07-68d1-47a2-9a0d-f0c662621f3f backed by image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86972) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:12 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:12 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2d9e5a-fa75-4302-b0cd-e471a655f60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbbd7a0-5b69-46b9-bc5c-8ec0fde9a1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:13 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Volume volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f (22db3c07-68d1-47a2-9a0d-f0c662621f3f): created successfully Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbbd7a0-5b69-46b9-bc5c-8ec0fde9a1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (81b86333-782a-4b15-8af9-45a1c732c89c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9430a1c5-fc1b-47e9-96d6-1a764b470a47 tempest-VolumesGetTest-81576646 None] Created volume successfully. Jul 07 18:15:13 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.837s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Deleted volume successfully. Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b5c1d1d3-4cee-4236-a001-f2ba2e3c7b93 tempest-VolumeDependencyTests-44143413 None] Lock "cinder-8b138a3e-14b1-40a8-b9db-75d2bf3c8f42-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-b0a2fefc-0360-4f0c-bd9a-3151de09f59a req-9c6f0839-9b7b-445a-bbb0-608f8c8a7d85 tempest-TestInstancesWithCinderVolumes-1055789454 None] Terminate volume connection completed successfully. Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-b0a2fefc-0360-4f0c-bd9a-3151de09f59a req-9c6f0839-9b7b-445a-bbb0-608f8c8a7d85 tempest-TestInstancesWithCinderVolumes-1055789454 None] Deleting attachment 405b1b93-90e9-4650-bef7-409a303dca51. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:15:13 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.773s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:15:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (49b69443-f803-467a-9d95-49f7590b5588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243b0675-d78a-4d82-accf-24614cdb8b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243b0675-d78a-4d82-accf-24614cdb8b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1150567059',display_name='tempest-VolumesGetTest-Volume-2017198097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f61303-0cca-4c55-bc39-a9e04dc7df43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:15Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a25411c-4931-4111-b431-b7260721828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a25411c-4931-4111-b431-b7260721828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59981467-5ef0-4f23-96c1-8c744e9d719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59981467-5ef0-4f23-96c1-8c744e9d719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f61303-0cca-4c55-bc39-a9e04dc7df43', 'volume_name': 'volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3559cf01-bb30-4af0-b3ad-06a1bcee59b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3559cf01-bb30-4af0-b3ad-06a1bcee59b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520fe839-456a-4aa5-a575-e3e25369a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:14 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Volume d8f61303-0cca-4c55-bc39-a9e04dc7df43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43', 'volume_size': 1} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1150567059',display_name='tempest-VolumesGetTest-Volume-2017198097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f61303-0cca-4c55-bc39-a9e04dc7df43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4d21cc36054383b63b2340265c0952',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:15Z,use_quota=True,user_id='e97584512a2d4bfe9f336b23da705ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Creating volume d8f61303-0cca-4c55-bc39-a9e04dc7df43 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:14 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:15:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:14 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 1073741824 Jul 07 18:15:14 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "cinder-3b1e3623-fe92-4bec-95e7-40433e50ee20-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-3b1e3623-fe92-4bec-95e7-40433e50ee20-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "cinder-quobyte-3b1e3623-fe92-4bec-95e7-40433e50ee20" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-quobyte-3b1e3623-fe92-4bec-95e7-40433e50ee20" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:15 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7d48c-1406-4bce-a295-66ba76729d5c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:15 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 Jul 07 18:15:15 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:15 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 1073741824" returned: 0 in 0.964s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:15 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 Jul 07 18:15:15 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:16 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20" returned: 0 in 0.996s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:16 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20 Jul 07 18:15:16 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:16 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43" returned: 0 in 0.755s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:16 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520fe839-456a-4aa5-a575-e3e25369a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a391e5-f027-4297-bcf3-dbb6d876424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:16 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Volume volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 (d8f61303-0cca-4c55-bc39-a9e04dc7df43): created successfully Jul 07 18:15:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a391e5-f027-4297-bcf3-dbb6d876424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Flow 'volume_create_manager' (49b69443-f803-467a-9d95-49f7590b5588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:16 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-540259b6-f666-4796-959c-8305dac4051b tempest-VolumesGetTest-81576646 None] Created volume successfully. Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-d8f61303-0cca-4c55-bc39-a9e04dc7df43-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Lock "cinder-d8f61303-0cca-4c55-bc39-a9e04dc7df43-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-quobyte-d8f61303-0cca-4c55-bc39-a9e04dc7df43" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-d8f61303-0cca-4c55-bc39-a9e04dc7df43" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5b3c24-7bd1-4b13-9bfc-c319f4283693]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:17 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 Jul 07 18:15:17 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:17 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3b1e3623-fe92-4bec-95e7-40433e50ee20" returned: 0 in 0.883s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-quobyte-3b1e3623-fe92-4bec-95e7-40433e50ee20" released by "delete_volume" :: held 1.940s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:17 devstack cinder-volume[86972]: WARNING cinder.quota [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-871424593-380266888 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-871424593-380266888, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:15:17 devstack cinder-volume[86972]: WARNING cinder.quota [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-871424593-380266888 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-871424593-380266888, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Created reservations ['d7feb841-408d-4176-98a4-af43389c48d5', '7f7b87f7-aa69-4611-b4f9-37d979c5be84', '85c3bbe2-b781-440b-8472-c80ce34e1ecb', 'c8f714ab-2fdc-4cb4-8c69-0ef954150a51'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:17 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:17 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:18 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43" returned: 0 in 0.939s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:18 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43 Jul 07 18:15:18 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:18 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.769s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:18 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:18 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Deleted volume successfully. Jul 07 18:15:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0a6c54cd-d30a-4bb8-a8a8-2f307c44c124 tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-3b1e3623-fe92-4bec-95e7-40433e50ee20-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:18 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d8f61303-0cca-4c55-bc39-a9e04dc7df43" returned: 0 in 0.699s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-d8f61303-0cca-4c55-bc39-a9e04dc7df43" released by "delete_volume" :: held 1.688s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:18 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Created reservations ['3e11f34d-56c9-41d9-b977-2fc87ce79c4d', 'be45cf27-1867-45ed-a0a6-aada6d675038', '2ebfa794-b198-4adb-aace-29bb98fd0ea1', '20b676bb-68ca-4197-8e83-16e465dc0c22'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:19 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:19 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=108,cinder:INSERT=43,cinder:UPDATE=135,cinder:DELETE=18 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=122,cinder:INSERT=39,cinder:UPDATE=154,cinder:DELETE=3 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Flow 'volume_create_manager' (73ab933c-73d0-42fd-b3c4-3c4ceefff77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22acc79-bbd8-4c2f-adae-6fd7dc6757ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22acc79-bbd8-4c2f-adae-6fd7dc6757ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ad37ca-5511-44eb-a349-4b642b6084c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad859186bfea4c7daded298d898ea461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:19Z,use_quota=True,user_id='fd11e7af3ffc4522a5b25cb14d5eac0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bb64bd-6c00-4309-a07b-d7858382501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7bb64bd-6c00-4309-a07b-d7858382501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd67ec73-b6ed-4edd-ac77-4a60e43e2131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.image.glance [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Creating Keystone auth plugin from conf {{(pid=86972) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-22db3c07-68d1-47a2-9a0d-f0c662621f3f-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Lock "cinder-22db3c07-68d1-47a2-9a0d-f0c662621f3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Acquiring lock "cinder-quobyte-22db3c07-68d1-47a2-9a0d-f0c662621f3f" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-22db3c07-68d1-47a2-9a0d-f0c662621f3f" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44b957e-2cb2-4be2-b854-f6f6ab1fa3ae]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd67ec73-b6ed-4edd-ac77-4a60e43e2131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '27ad37ca-5511-44eb-a349-4b642b6084c3', 'volume_name': 'volume-27ad37ca-5511-44eb-a349-4b642b6084c3', 'volume_size': 1, 'image_id': '29aa9278-620c-416e-8d82-be6e2b409652', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29aa9278-620c-416e-8d82-be6e2b409652', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd93b2995f3c728b84978cb16b1934b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad859186bfea4c7daded298d898ea461', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '848a2f5957a1fae03d35569901d8861b32e86475c5cd36837a705b2af30da1d389cd3d526de65d7adade2aa0ee669b04d2593eb24d23108533510f677c692c28', 'id': '29aa9278-620c-416e-8d82-be6e2b409652', 'created_at': datetime.datetime(2026, 7, 7, 16, 15, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29aa9278-620c-416e-8d82-be6e2b409652/file', 'properties': {}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed333451-a007-47ee-ac68-f0b6a9e4613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed333451-a007-47ee-ac68-f0b6a9e4613b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d59cc4-17b8-41b6-aec3-9548de9266aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:19 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Volume 27ad37ca-5511-44eb-a349-4b642b6084c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-27ad37ca-5511-44eb-a349-4b642b6084c3', 'volume_size': 1, 'image_id': '29aa9278-620c-416e-8d82-be6e2b409652', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29aa9278-620c-416e-8d82-be6e2b409652', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd93b2995f3c728b84978cb16b1934b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad859186bfea4c7daded298d898ea461', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '848a2f5957a1fae03d35569901d8861b32e86475c5cd36837a705b2af30da1d389cd3d526de65d7adade2aa0ee669b04d2593eb24d23108533510f677c692c28', 'id': '29aa9278-620c-416e-8d82-be6e2b409652', 'created_at': datetime.datetime(2026, 7, 7, 16, 15, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29aa9278-620c-416e-8d82-be6e2b409652/file', 'properties': {}}, 'image_service': } Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Trying to clone 27ad37ca-5511-44eb-a349-4b642b6084c3 from image 29aa9278-620c-416e-8d82-be6e2b409652 at location (None, [{'url': 'file:///opt/stack/data/glance/images/29aa9278-620c-416e-8d82-be6e2b409652', 'metadata': {}}]). {{(pid=86972) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 18:15:19 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f Jul 07 18:15:19 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:15:19 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Image download 0.00 MB at 0.00 MB/s Jul 07 18:15:19 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.888s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Deleted volume successfully. Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7a6504-ff7f-4871-8826-b8ba9eb54af5]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ef24ec63-2b2a-411c-8010-090a5b7a74ad tempest-VolumesGetTest-81576646 None] Lock "cinder-d8f61303-0cca-4c55-bc39-a9e04dc7df43-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:20 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD Jul 07 18:15:20 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:20 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f" returned: 0 in 0.952s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:20 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f Jul 07 18:15:20 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-1dd75f8e-5433-47f1-9f89-da1a7ad8dda1 req-9c674fbd-76d6-4917-a1b8-03b454f8e457 tempest-TestInstancesWithCinderVolumes-1055789454 None] Terminate volume connection completed successfully. Jul 07 18:15:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-1dd75f8e-5433-47f1-9f89-da1a7ad8dda1 req-9c674fbd-76d6-4917-a1b8-03b454f8e457 tempest-TestInstancesWithCinderVolumes-1055789454 None] Deleting attachment a3910507-03b7-41a1-b6d0-56edcfb8470f. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:15:20 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD" returned: 0 in 0.893s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:20 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD Jul 07 18:15:20 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:21 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f" returned: 1 in 0.875s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:21 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f Jul 07 18:15:21 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:21 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD" returned: 1 in 0.807s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:21 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Temporary image 29aa9278-620c-416e-8d82-be6e2b409652 is fetched for user fd11e7af3ffc4522a5b25cb14d5eac0b. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:15:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26f8895-3b53-48a1-9ccb-fb2b0a7137be]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:21 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD Jul 07 18:15:21 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:22 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-22db3c07-68d1-47a2-9a0d-f0c662621f3f" returned: 0 in 0.691s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Lock "cinder-quobyte-22db3c07-68d1-47a2-9a0d-f0c662621f3f" released by "delete_volume" :: held 2.599s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Created reservations ['5ca397e7-a117-4c6c-9853-af45ce5f85e0', 'c7653d46-4abc-4254-998f-8b5dda586e91', '1a02f80e-01d5-442b-a2b4-7e08a81a67de', '9042afd4-a874-4d76-8a58-702c336d47d8'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:22 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:22 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:22 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD" returned: 0 in 0.816s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:22 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD Jul 07 18:15:22 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "cinder-d4ecc524-30f8-4a6e-b97f-fe283ee0e627-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-d4ecc524-30f8-4a6e-b97f-fe283ee0e627-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "cinder-quobyte-d4ecc524-30f8-4a6e-b97f-fe283ee0e627" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-quobyte-d4ecc524-30f8-4a6e-b97f-fe283ee0e627" acquired by "delete_volume" :: waited 0.039s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[860724a8-a22d-499d-bdcd-3ee317ff697b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:23 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.860s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Deleted volume successfully. Jul 07 18:15:23 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 Jul 07 18:15:23 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0370548b-830b-40a0-bde8-f2e274268842 tempest-VolumesGetTest-81576646 None] Lock "cinder-22db3c07-68d1-47a2-9a0d-f0c662621f3f-delete_volume" released by "delete_volume" :: held 3.740s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:23 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD" returned: 1 in 1.134s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ad37ca-5511-44eb-a349-4b642b6084c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad859186bfea4c7daded298d898ea461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:19Z,use_quota=True,user_id='fd11e7af3ffc4522a5b25cb14d5eac0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Creating volume 27ad37ca-5511-44eb-a349-4b642b6084c3 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:23 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:15:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:23 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 1073741824 Jul 07 18:15:23 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:24 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627" returned: 0 in 1.310s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:24 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627 Jul 07 18:15:24 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:24 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 1073741824" returned: 0 in 1.230s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:25 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 Jul 07 18:15:25 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:25 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d4ecc524-30f8-4a6e-b97f-fe283ee0e627" returned: 0 in 1.001s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-quobyte-d4ecc524-30f8-4a6e-b97f-fe283ee0e627" released by "delete_volume" :: held 2.389s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:25 devstack cinder-volume[86972]: WARNING cinder.quota [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2088145090-1163819411 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2088145090-1163819411, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:15:25 devstack cinder-volume[86972]: WARNING cinder.quota [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2088145090-1163819411 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2088145090-1163819411, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:15:25 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Created reservations ['d4c6c449-9dd3-491b-aac5-d905d8a9c728', 'dc4a4d19-34fc-4989-a0a8-99460c724e70', '8020d286-abc7-4c0d-8671-928fde943c04', '5d0e33c1-f27f-4610-8db9-a323752c6174'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:25 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:25 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:26 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3" returned: 0 in 1.099s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.412s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:26 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Attempting download of 29aa9278-620c-416e-8d82-be6e2b409652 ((None, [{'url': 'file:///opt/stack/data/glance/images/29aa9278-620c-416e-8d82-be6e2b409652', 'metadata': {}}])) to volume 27ad37ca-5511-44eb-a349-4b642b6084c3. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:15:26 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9361ba15-4a4d-4b41-a974-f5a58c798b94]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29aa9278-620c-416e-8d82-be6e2b409652_u2nmdizb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:26 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29aa9278-620c-416e-8d82-be6e2b409652_u2nmdizb Jul 07 18:15:26 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:26 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.884s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:26 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Deleted volume successfully. Jul 07 18:15:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8fc3733e-e938-4d44-b8ff-91017fb2e54d tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-d4ecc524-30f8-4a6e-b97f-fe283ee0e627-delete_volume" released by "delete_volume" :: held 3.646s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:27 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_29aa9278-620c-416e-8d82-be6e2b409652_u2nmdizb" returned: 0 in 1.039s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29aa9278-620c-416e-8d82-be6e2b409652_u2nmdizb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:27 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29aa9278-620c-416e-8d82-be6e2b409652_u2nmdizb Jul 07 18:15:27 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Flow 'volume_create_manager' (ad0de286-95bd-447e-8c7b-f4512b7706d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723c130b-e6b8-492c-962a-875eaa65a941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723c130b-e6b8-492c-962a-875eaa65a941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1273350768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81c2e1b-4b78-45f1-a827-aecc876516e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba5a079abf54de5ae0ed44234215a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:27Z,use_quota=True,user_id='2e458af2937046a8a0806cc5947e1445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee83d4e-5ae4-4b1e-88bb-f89d480d65a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee83d4e-5ae4-4b1e-88bb-f89d480d65a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36cd25a-e462-4575-afe6-528086d46484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36cd25a-e462-4575-afe6-528086d46484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81c2e1b-4b78-45f1-a827-aecc876516e0', 'volume_name': 'volume-e81c2e1b-4b78-45f1-a827-aecc876516e0', 'volume_size': 2}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e360bb22-5be1-47fa-bac2-097ca3fbd348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e360bb22-5be1-47fa-bac2-097ca3fbd348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd8ba90-ec23-4042-a664-401f776be3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:27 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Volume e81c2e1b-4b78-45f1-a827-aecc876516e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81c2e1b-4b78-45f1-a827-aecc876516e0', 'volume_size': 2} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1273350768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81c2e1b-4b78-45f1-a827-aecc876516e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba5a079abf54de5ae0ed44234215a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:15:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:15:27Z,use_quota=True,user_id='2e458af2937046a8a0806cc5947e1445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Creating volume e81c2e1b-4b78-45f1-a827-aecc876516e0 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:15:27 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:15:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 2147483648 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:27 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 2147483648 Jul 07 18:15:27 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:28 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29aa9278-620c-416e-8d82-be6e2b409652_u2nmdizb" returned: 1 in 0.829s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_29aa9278-620c-416e-8d82-be6e2b409652_u2nmdizb' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:28 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16e3eb0-d012-49b7-bd75-018694d6eede]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:28 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD Jul 07 18:15:28 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:28 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 2147483648" returned: 0 in 1.129s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:28 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 Jul 07 18:15:28 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:29 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD" returned: 0 in 1.023s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:29 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD Jul 07 18:15:29 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:29 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:15:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd8ba90-ec23-4042-a664-401f776be3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81c2e1b-4b78-45f1-a827-aecc876516e0', 'volume_size': 2}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65ddfd9-fc38-472d-9da1-afde4e959211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:29 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Volume volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 (e81c2e1b-4b78-45f1-a827-aecc876516e0): created successfully Jul 07 18:15:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65ddfd9-fc38-472d-9da1-afde4e959211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Flow 'volume_create_manager' (ad0de286-95bd-447e-8c7b-f4512b7706d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:29 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2d69707d-7854-4ca1-ab4c-3fdd7d0ce991 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Created volume successfully. Jul 07 18:15:30 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD" returned: 1 in 0.927s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] 29aa9278-620c-416e-8d82-be6e2b409652 was raw, converting to raw {{(pid=86972) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:30 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 Jul 07 18:15:30 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Creating offline snapshot 4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e of volume e81c2e1b-4b78-45f1-a827-aecc876516e0 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6cc6a4-5592-4a01-aef2-b39c8f19d7e4]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:30 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3" returned: 0 in 0.816s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_29aa9278-620c-416e-8d82-be6e2b409652_a3bdn5a7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:15:30 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 18:15:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:30 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 1G Jul 07 18:15:30 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:30 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 Jul 07 18:15:30 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:31 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-3c501da6-0fe1-4efd-8ea2-fb9a56277db6 req-09c36163-b2d8-4aeb-bbf2-8740fb37af24 tempest-TestInstancesWithCinderVolumes-1055789454 None] Terminate volume connection completed successfully. Jul 07 18:15:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-3c501da6-0fe1-4efd-8ea2-fb9a56277db6 req-09c36163-b2d8-4aeb-bbf2-8740fb37af24 tempest-TestInstancesWithCinderVolumes-1055789454 None] Deleting attachment b4309650-f368-4223-b827-5bd52e068b4f. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:15:31 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 1G" returned: 0 in 0.731s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:31 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[861575e8-1b1c-454a-a6d0-951063893faa]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:31 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e 2G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:31 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e 2G Jul 07 18:15:31 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:31 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 Jul 07 18:15:31 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:32 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3" returned: 0 in 0.840s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:32 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e 2G" returned: 0 in 0.849s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:32 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e Jul 07 18:15:32 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:32 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 Jul 07 18:15:32 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:33 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3" returned: 1 in 0.774s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Downloaded image 29aa9278-620c-416e-8d82-be6e2b409652 ((None, [{'url': 'file:///opt/stack/data/glance/images/29aa9278-620c-416e-8d82-be6e2b409652', 'metadata': {}}])) to volume 27ad37ca-5511-44eb-a349-4b642b6084c3 successfully. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Temporary image 29aa9278-620c-416e-8d82-be6e2b409652 for user fd11e7af3ffc4522a5b25cb14d5eac0b is deleted. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Marking volume 27ad37ca-5511-44eb-a349-4b642b6084c3 as bootable. {{(pid=86972) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Copying metadata from image 29aa9278-620c-416e-8d82-be6e2b409652 to 27ad37ca-5511-44eb-a349-4b642b6084c3. {{(pid=86972) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Creating volume glance metadata for volume 27ad37ca-5511-44eb-a349-4b642b6084c3 backed by image 29aa9278-620c-416e-8d82-be6e2b409652 with: {'image_id': '29aa9278-620c-416e-8d82-be6e2b409652', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'dd93b2995f3c728b84978cb16b1934b3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86972) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:15:33 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e" returned: 0 in 0.759s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:33 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e is being set with open permissions: ugo+rw Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:33 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e Jul 07 18:15:33 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d59cc4-17b8-41b6-aec3-9548de9266aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ad37ca-5511-44eb-a349-4b642b6084c3', 'volume_size': 1, 'image_id': '29aa9278-620c-416e-8d82-be6e2b409652', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/29aa9278-620c-416e-8d82-be6e2b409652', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dd93b2995f3c728b84978cb16b1934b3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad859186bfea4c7daded298d898ea461', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '848a2f5957a1fae03d35569901d8861b32e86475c5cd36837a705b2af30da1d389cd3d526de65d7adade2aa0ee669b04d2593eb24d23108533510f677c692c28', 'id': '29aa9278-620c-416e-8d82-be6e2b409652', 'created_at': datetime.datetime(2026, 7, 7, 16, 15, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 15, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/29aa9278-620c-416e-8d82-be6e2b409652/file', 'properties': {}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253dafbf-6543-401d-b13b-3243f6fe8483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:15:33 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Volume volume-27ad37ca-5511-44eb-a349-4b642b6084c3 (27ad37ca-5511-44eb-a349-4b642b6084c3): created successfully Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253dafbf-6543-401d-b13b-3243f6fe8483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Flow 'volume_create_manager' (73ab933c-73d0-42fd-b3c4-3c4ceefff77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:15:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fee2524f-e3ac-48b7-aec9-adcf32ca0577 tempest-VolumeImageDependencyTests-1062343802 None] Created volume successfully. Jul 07 18:15:33 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e" returned: 0 in 0.657s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:33 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.info Jul 07 18:15:33 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "cinder-e9a9843e-a1d1-4178-9439-d17d2180a6a4-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-e9a9843e-a1d1-4178-9439-d17d2180a6a4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Acquiring lock "cinder-27ad37ca-5511-44eb-a349-4b642b6084c3-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "cinder-quobyte-e9a9843e-a1d1-4178-9439-d17d2180a6a4" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Lock "cinder-27ad37ca-5511-44eb-a349-4b642b6084c3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-quobyte-e9a9843e-a1d1-4178-9439-d17d2180a6a4" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Acquiring lock "cinder-quobyte-27ad37ca-5511-44eb-a349-4b642b6084c3" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Lock "cinder-quobyte-27ad37ca-5511-44eb-a349-4b642b6084c3" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7856b8e4-d71d-4e04-882c-91264896ed90]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a201d84-f891-4620-8c24-ef59d4b4fced]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:34 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.info" returned: 0 in 0.739s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:34 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.info is being set with open permissions: ugo+rw Jul 07 18:15:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:34 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.info Jul 07 18:15:34 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 Jul 07 18:15:34 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:34 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:34 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 Jul 07 18:15:34 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:35 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4" returned: 0 in 0.793s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:35 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.info" returned: 0 in 0.720s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:35 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.678s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3" returned: 0 in 0.795s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fa667afd-b02f-4d39-97b4-ec7315b4ff63 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Create snapshot completed successfully Jul 07 18:15:35 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 Jul 07 18:15:35 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:35 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 Jul 07 18:15:35 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Acquiring lock "cinder-4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Acquiring lock "cinder-quobyte-e81c2e1b-4b78-45f1-a827-aecc876516e0" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-quobyte-e81c2e1b-4b78-45f1-a827-aecc876516e0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Acquiring lock "cinder-quobyte-4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-quobyte-4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Deleting offline snapshot 4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e of volume e81c2e1b-4b78-45f1-a827-aecc876516e0 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] snapshot_file for this snap is: volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2e5c1b-cd93-4391-a098-c20798e510ab]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:36 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4" returned: 1 in 0.825s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:36 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3" returned: 1 in 0.805s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:36 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4 Jul 07 18:15:36 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:36 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3 Jul 07 18:15:36 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:36 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e Jul 07 18:15:36 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:36 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e9a9843e-a1d1-4178-9439-d17d2180a6a4" returned: 0 in 0.671s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-quobyte-e9a9843e-a1d1-4178-9439-d17d2180a6a4" released by "delete_volume" :: held 2.389s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:36 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-27ad37ca-5511-44eb-a349-4b642b6084c3" returned: 0 in 0.678s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Lock "cinder-quobyte-27ad37ca-5511-44eb-a349-4b642b6084c3" released by "delete_volume" :: held 2.363s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:36 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:36 devstack cinder-volume[86972]: WARNING cinder.quota [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-770409797-1902547322 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-770409797-1902547322, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:15:36 devstack cinder-volume[86972]: WARNING cinder.quota [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-770409797-1902547322 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-770409797-1902547322, it is now deprecated. Please use the default quota class for default quota. Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e" returned: 0 in 0.801s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e81c2e1b-4b78-45f1-a827-aecc876516e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8762fdac-52c1-4c07-8711-4ee9439c24b9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Created reservations ['142fe7f8-5a7e-4f2f-911c-46fb17868505', '008ad417-94ff-4ede-9f52-2098e5f5ed51', '63639077-9e58-40b7-a820-db1b052775bd', 'dd8ee453-2a11-4323-ae20-0c9e8e372307'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Created reservations ['d4d3db77-6638-4c27-8e8a-8fc3deb1b2f9', 'c4d0f980-433b-4f43-bf24-90d80d34463f', '7cf02352-6fb0-419f-bdb9-eb025f680d8c', '39291f2c-a860-42c0-a892-4b5210f32f68'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:37 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 Jul 07 18:15:37 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:37 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:37 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:37 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:37 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:37 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.729s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:37 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Deleted volume successfully. Jul 07 18:15:37 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.714s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:37 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Deleted volume successfully. Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a5f50e62-f084-4695-b0ec-ba5d35d8a9cb tempest-TestInstancesWithCinderVolumes-1055789454 None] Lock "cinder-e9a9843e-a1d1-4178-9439-d17d2180a6a4-delete_volume" released by "delete_volume" :: held 3.511s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:37 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0" returned: 0 in 0.939s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5a2d094e-798e-479c-bc8c-40d0edd2e647 tempest-VolumeImageDependencyTests-1062343802 None] Lock "cinder-27ad37ca-5511-44eb-a349-4b642b6084c3-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:38 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e Jul 07 18:15:38 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:38 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e" returned: 0 in 0.898s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:38 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e Jul 07 18:15:38 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:39 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0.4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e" returned: 0 in 0.773s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-quobyte-4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e" released by "_delete_snapshot" :: held 3.550s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-quobyte-e81c2e1b-4b78-45f1-a827-aecc876516e0" released by "delete_snapshot" :: held 3.583s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:39 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Created reservations ['74f19b5d-589d-422d-899c-f9994e723cf3', '2b9576f0-9a76-433e-a77f-401cc23b70e4', 'b709484b-d563-4ce0-a009-d09e8acba863', '427932b8-0289-4760-8ab8-b0032563fe41'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:39 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Delete snapshot completed successfully. Jul 07 18:15:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f27fc6ab-33a0-40d2-a16a-1ab90ebf9857 tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-4aaa6fde-9a30-48d8-9f7d-6544f48bdb8e-delete_snapshot" released by "delete_snapshot" :: held 3.770s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Acquiring lock "cinder-e81c2e1b-4b78-45f1-a827-aecc876516e0-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-e81c2e1b-4b78-45f1-a827-aecc876516e0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Acquiring lock "cinder-quobyte-e81c2e1b-4b78-45f1-a827-aecc876516e0" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:15:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-quobyte-e81c2e1b-4b78-45f1-a827-aecc876516e0" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:15:40 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abe0d23-dbfd-43c0-b0b3-fc013819afbc]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:15:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:40 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 Jul 07 18:15:40 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:41 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0" returned: 0 in 0.802s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:41 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0 Jul 07 18:15:41 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:42 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e81c2e1b-4b78-45f1-a827-aecc876516e0" returned: 0 in 0.747s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-quobyte-e81c2e1b-4b78-45f1-a827-aecc876516e0" released by "delete_volume" :: held 1.606s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Created reservations ['eaf742ba-9965-4b13-a973-30367740caa7', '4d7dd139-c632-4de6-af2f-ecd50d0ac79b', '2c063ef8-6bf9-4e1e-8c7a-bebf87ecd9b0', '719484a1-9a1d-43c0-8d5c-1a50e5a2e6b9'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:15:42 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:15:42 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:15:42 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.671s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:15:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Deleted volume successfully. Jul 07 18:15:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-d0df82cf-f701-460c-9788-304e786c086a tempest-VolumesSnapshotNegativeTestJSON-1983360682 None] Lock "cinder-e81c2e1b-4b78-45f1-a827-aecc876516e0-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:15:52 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=49,cinder:INSERT=19,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:16:01 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=55,cinder:DELETE=6,cinder:SELECT=42,cinder:INSERT=17 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Flow 'volume_create_manager' (ff206456-87a6-4d50-b13b-daa9c40e2397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1320cf-5ff6-4d47-a3ad-2e1b93b017d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1320cf-5ff6-4d47-a3ad-2e1b93b017d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1316436616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7b9c21-fe9b-471c-8672-c8ac91b96219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9625a22bc37c40d596a828cd476100c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:09Z,use_quota=True,user_id='aa9cd31ebd5d4600a59f9e0ec7c45489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8c9e0b-6561-4d09-ab26-7bcf2b1ccaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8c9e0b-6561-4d09-ab26-7bcf2b1ccaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2b1405-0f77-4763-ae34-c501e1ca5494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2b1405-0f77-4763-ae34-c501e1ca5494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7b9c21-fe9b-471c-8672-c8ac91b96219', 'volume_name': 'volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c4d3b7-9195-4b00-95a0-3eb65b47dd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c4d3b7-9195-4b00-95a0-3eb65b47dd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4666750-b5a5-4bde-97e1-f67e17b388be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:08 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Volume ed7b9c21-fe9b-471c-8672-c8ac91b96219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219', 'volume_size': 1} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1316436616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7b9c21-fe9b-471c-8672-c8ac91b96219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9625a22bc37c40d596a828cd476100c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:09Z,use_quota=True,user_id='aa9cd31ebd5d4600a59f9e0ec7c45489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Creating volume ed7b9c21-fe9b-471c-8672-c8ac91b96219 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:08 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:16:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:08 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 1073741824 Jul 07 18:16:08 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Flow 'volume_create_manager' (b45392ae-e613-4e0f-97e6-1a7a8545da8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc09e5a-0e71-4794-a734-0629210e1ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc09e5a-0e71-4794-a734-0629210e1ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1712603198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b041913-817d-4095-ba0d-9766b6a760db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9625a22bc37c40d596a828cd476100c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:09Z,use_quota=True,user_id='aa9cd31ebd5d4600a59f9e0ec7c45489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34516d7c-e193-480c-b7ed-c9ac2f66ecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34516d7c-e193-480c-b7ed-c9ac2f66ecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ec5018-d306-4f0c-ad22-761273fa6720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00ec5018-d306-4f0c-ad22-761273fa6720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b041913-817d-4095-ba0d-9766b6a760db', 'volume_name': 'volume-1b041913-817d-4095-ba0d-9766b6a760db', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0502388-c291-4d15-b68b-c26be706d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0502388-c291-4d15-b68b-c26be706d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddb27ff-d1a3-48dc-aa6e-89c8c6db26cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:09 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Volume 1b041913-817d-4095-ba0d-9766b6a760db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b041913-817d-4095-ba0d-9766b6a760db', 'volume_size': 1} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:09 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 1073741824" returned: 0 in 1.026s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:09 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 Jul 07 18:16:09 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:10 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219" returned: 0 in 0.723s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.315s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1712603198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b041913-817d-4095-ba0d-9766b6a760db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9625a22bc37c40d596a828cd476100c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:09Z,use_quota=True,user_id='aa9cd31ebd5d4600a59f9e0ec7c45489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Creating volume 1b041913-817d-4095-ba0d-9766b6a760db {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:10 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4666750-b5a5-4bde-97e1-f67e17b388be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:10 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db 1073741824 Jul 07 18:16:10 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19dab9b6-2491-47c3-9919-bfed3723e77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:10 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Volume volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 (ed7b9c21-fe9b-471c-8672-c8ac91b96219): created successfully Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19dab9b6-2491-47c3-9919-bfed3723e77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Flow 'volume_create_manager' (ff206456-87a6-4d50-b13b-daa9c40e2397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-13eea83a-d249-4cfd-a5a5-bd9fa1e05e58 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Created volume successfully. Jul 07 18:16:11 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db 1073741824" returned: 0 in 1.087s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:11 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db Jul 07 18:16:11 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:12 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db" returned: 0 in 0.739s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddb27ff-d1a3-48dc-aa6e-89c8c6db26cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b041913-817d-4095-ba0d-9766b6a760db', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb0e2c3-ab92-4838-81d5-3bb46da52909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:12 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Volume volume-1b041913-817d-4095-ba0d-9766b6a760db (1b041913-817d-4095-ba0d-9766b6a760db): created successfully Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb0e2c3-ab92-4838-81d5-3bb46da52909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Flow 'volume_create_manager' (b45392ae-e613-4e0f-97e6-1a7a8545da8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:12 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d1517d8c-fdfb-407f-b22c-ac6e5d9409be tempest-TestServerVolumeAttachmentScenario-1927089952 None] Created volume successfully. Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:12 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:16:12 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:13 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.899s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:16:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:16:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:16:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:16:22 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:16:22 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Flow 'volume_create_manager' (e8361b30-3315-44d0-a724-4a498a46b76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecc911d-fdb4-416e-a3aa-28f8cbb4829f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fecc911d-fdb4-416e-a3aa-28f8cbb4829f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2084253284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b48016-be7b-4c21-b9b7-4d17c9763777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f42c67d50e4b0e99d208a548982911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:34Z,use_quota=True,user_id='36c3ea87d5ae4f7b9579ddd71afab064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8299e3-6a84-47f8-a841-cb94ba5e7b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8299e3-6a84-47f8-a841-cb94ba5e7b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f27f7e-6db2-48f4-86aa-4fcb482a2aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f27f7e-6db2-48f4-86aa-4fcb482a2aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b48016-be7b-4c21-b9b7-4d17c9763777', 'volume_name': 'volume-08b48016-be7b-4c21-b9b7-4d17c9763777', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e7cd90-9c00-4362-88ef-58641ffe4fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e7cd90-9c00-4362-88ef-58641ffe4fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cc93f6-6051-4fc9-b8d2-2d244b9fa293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:34 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Volume 08b48016-be7b-4c21-b9b7-4d17c9763777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b48016-be7b-4c21-b9b7-4d17c9763777', 'volume_size': 1} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2084253284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b48016-be7b-4c21-b9b7-4d17c9763777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53f42c67d50e4b0e99d208a548982911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:16:34Z,use_quota=True,user_id='36c3ea87d5ae4f7b9579ddd71afab064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Creating volume 08b48016-be7b-4c21-b9b7-4d17c9763777 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:16:34 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:34 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 1073741824 Jul 07 18:16:34 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:34 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 1073741824" returned: 0 in 0.863s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:35 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 Jul 07 18:16:35 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:35 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777" returned: 0 in 0.635s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:16:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cc93f6-6051-4fc9-b8d2-2d244b9fa293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b48016-be7b-4c21-b9b7-4d17c9763777', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e7173a-de7a-45d9-b569-170f1ed35960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:16:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Volume volume-08b48016-be7b-4c21-b9b7-4d17c9763777 (08b48016-be7b-4c21-b9b7-4d17c9763777): created successfully Jul 07 18:16:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08e7173a-de7a-45d9-b569-170f1ed35960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:16:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Flow 'volume_create_manager' (e8361b30-3315-44d0-a724-4a498a46b76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:16:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-02ddf5b5-23ae-4825-bd46-498af614e543 tempest-TestMinimumBasicScenario-124619590 None] Created volume successfully. Jul 07 18:16:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-409fe10f-bf42-43ef-a2b8-8fe45963da4d req-d5dea4f3-b0f4-4f6b-94c3-8bab3ceb3188 tempest-TestMinimumBasicScenario-124619590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-409fe10f-bf42-43ef-a2b8-8fe45963da4d req-d5dea4f3-b0f4-4f6b-94c3-8bab3ceb3188 tempest-TestMinimumBasicScenario-124619590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:39 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[244f9940-2944-4811-9a65-e42769dc6721]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-409fe10f-bf42-43ef-a2b8-8fe45963da4d req-d5dea4f3-b0f4-4f6b-94c3-8bab3ceb3188 tempest-TestMinimumBasicScenario-124619590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:39 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 Jul 07 18:16:39 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:40 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-409fe10f-bf42-43ef-a2b8-8fe45963da4d req-d5dea4f3-b0f4-4f6b-94c3-8bab3ceb3188 tempest-TestMinimumBasicScenario-124619590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777" returned: 0 in 0.752s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-409fe10f-bf42-43ef-a2b8-8fe45963da4d req-d5dea4f3-b0f4-4f6b-94c3-8bab3ceb3188 tempest-TestMinimumBasicScenario-124619590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.767s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:40 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-409fe10f-bf42-43ef-a2b8-8fe45963da4d req-d5dea4f3-b0f4-4f6b-94c3-8bab3ceb3188 tempest-TestMinimumBasicScenario-124619590 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-08b48016-be7b-4c21-b9b7-4d17c9763777', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc97551c-9e27-4072-99b2-4d3baeba9215', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:16:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-409fe10f-bf42-43ef-a2b8-8fe45963da4d req-d5dea4f3-b0f4-4f6b-94c3-8bab3ceb3188 tempest-TestMinimumBasicScenario-124619590 None] attachment_update completed successfully. Jul 07 18:16:50 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:16:50 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=7,cinder:SELECT=7 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:16:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-0c0c752d-a9c5-4631-a51b-38fb1d999348 req-ed4b0bd0-c6c6-48ed-a93b-9b8999dd6801 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:16:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-0c0c752d-a9c5-4631-a51b-38fb1d999348 req-ed4b0bd0-c6c6-48ed-a93b-9b8999dd6801 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:16:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade0817f-981f-4d24-8949-e328e797199d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:16:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-0c0c752d-a9c5-4631-a51b-38fb1d999348 req-ed4b0bd0-c6c6-48ed-a93b-9b8999dd6801 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:16:53 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 Jul 07 18:16:53 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:16:54 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jul 07 18:16:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-0c0c752d-a9c5-4631-a51b-38fb1d999348 req-ed4b0bd0-c6c6-48ed-a93b-9b8999dd6801 tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219" returned: 0 in 0.781s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:16:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-0c0c752d-a9c5-4631-a51b-38fb1d999348 req-ed4b0bd0-c6c6-48ed-a93b-9b8999dd6801 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.796s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:16:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-0c0c752d-a9c5-4631-a51b-38fb1d999348 req-ed4b0bd0-c6c6-48ed-a93b-9b8999dd6801 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9cc5cab2-3bbf-42ef-ae3c-c5b5cb8aa797', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:16:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-0c0c752d-a9c5-4631-a51b-38fb1d999348 req-ed4b0bd0-c6c6-48ed-a93b-9b8999dd6801 tempest-TestServerVolumeAttachmentScenario-1927089952 None] attachment_update completed successfully. Jul 07 18:17:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-38411114-bff3-41d1-97b0-bf5b804a38c2 req-3b803245-7e83-48eb-882d-29c29c44c652 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-38411114-bff3-41d1-97b0-bf5b804a38c2 req-3b803245-7e83-48eb-882d-29c29c44c652 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:03 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6e8d14-8e98-49c5-8413-d640b500181e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-38411114-bff3-41d1-97b0-bf5b804a38c2 req-3b803245-7e83-48eb-882d-29c29c44c652 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:04 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db Jul 07 18:17:04 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:04 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-38411114-bff3-41d1-97b0-bf5b804a38c2 req-3b803245-7e83-48eb-882d-29c29c44c652 tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db" returned: 0 in 0.838s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-38411114-bff3-41d1-97b0-bf5b804a38c2 req-3b803245-7e83-48eb-882d-29c29c44c652 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.855s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-38411114-bff3-41d1-97b0-bf5b804a38c2 req-3b803245-7e83-48eb-882d-29c29c44c652 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-1b041913-817d-4095-ba0d-9766b6a760db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2f232d5-e451-4c37-b198-db4176dabc8e', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:17:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-38411114-bff3-41d1-97b0-bf5b804a38c2 req-3b803245-7e83-48eb-882d-29c29c44c652 tempest-TestServerVolumeAttachmentScenario-1927089952 None] attachment_update completed successfully. Jul 07 18:17:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-cbd65044-6641-485a-8e94-7df75742f148 req-27bb1e60-f2d8-4505-8b3b-5dbb1676cbcd tempest-TestServerVolumeAttachmentScenario-1927089952 None] Terminate volume connection completed successfully. Jul 07 18:17:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-cbd65044-6641-485a-8e94-7df75742f148 req-27bb1e60-f2d8-4505-8b3b-5dbb1676cbcd tempest-TestServerVolumeAttachmentScenario-1927089952 None] Deleting attachment e2f232d5-e451-4c37-b198-db4176dabc8e. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:17:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:17:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:12 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:17:12 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:13 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.700s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:17:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:17:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:17:14 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-d8c2f780-642c-447d-9f9f-8d6854a40c48 req-596883e9-5715-4766-a6df-c198ce8a7c68 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Terminate volume connection completed successfully. Jul 07 18:17:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-d8c2f780-642c-447d-9f9f-8d6854a40c48 req-596883e9-5715-4766-a6df-c198ce8a7c68 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Deleting attachment 9cc5cab2-3bbf-42ef-ae3c-c5b5cb8aa797. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:17:20 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=15,cinder:UPDATE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:17:24 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:17:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "cinder-1b041913-817d-4095-ba0d-9766b6a760db-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "cinder-1b041913-817d-4095-ba0d-9766b6a760db-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "cinder-quobyte-1b041913-817d-4095-ba0d-9766b6a760db" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "cinder-quobyte-1b041913-817d-4095-ba0d-9766b6a760db" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e7e557-0611-45f5-8dbe-36f6e5779231]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:24 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db Jul 07 18:17:25 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:25 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db" returned: 0 in 0.889s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:25 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db Jul 07 18:17:25 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:26 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1b041913-817d-4095-ba0d-9766b6a760db" returned: 0 in 0.649s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "cinder-quobyte-1b041913-817d-4095-ba0d-9766b6a760db" released by "delete_volume" :: held 1.603s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:26 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Created reservations ['77b5dd70-636f-4b3c-ac0e-25b275fb6834', '8eeeafb8-337d-47c3-b746-e54a6772edd7', '131ee96a-7fa1-4678-a211-9a5b382d27cf', 'd585a6f9-8ba0-40ef-8c39-2276ce58de26'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:26 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:17:26 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "cinder-ed7b9c21-fe9b-471c-8672-c8ac91b96219-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "cinder-ed7b9c21-fe9b-471c-8672-c8ac91b96219-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "cinder-quobyte-ed7b9c21-fe9b-471c-8672-c8ac91b96219" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "cinder-quobyte-ed7b9c21-fe9b-471c-8672-c8ac91b96219" acquired by "delete_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef867309-81c4-46f5-889f-e36d19742fc1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:27 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Deleted volume successfully. Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-4634d10b-d677-4601-bfd6-3f684c3ecc4c tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "cinder-1b041913-817d-4095-ba0d-9766b6a760db-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:27 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 Jul 07 18:17:27 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-9e65af4d-c5cf-4cc8-ade4-1ae6f1ed7a7f req-247ed346-8d67-49ee-b722-f150cf33bb74 tempest-TestMinimumBasicScenario-124619590 None] Terminate volume connection completed successfully. Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-9e65af4d-c5cf-4cc8-ade4-1ae6f1ed7a7f req-247ed346-8d67-49ee-b722-f150cf33bb74 tempest-TestMinimumBasicScenario-124619590 None] Deleting attachment fc97551c-9e27-4072-99b2-4d3baeba9215. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:17:27 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219" returned: 0 in 0.776s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:27 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219 Jul 07 18:17:27 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:28 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7b9c21-fe9b-471c-8672-c8ac91b96219" returned: 0 in 0.648s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "cinder-quobyte-ed7b9c21-fe9b-471c-8672-c8ac91b96219" released by "delete_volume" :: held 1.487s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:28 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Created reservations ['e5cd9adc-8eed-4991-9998-c86513c8efa7', '37b861cb-bef1-4b56-8535-37cecd43eae7', '80171f97-2d2a-4f22-ac21-e9146bd35417', '3ea690fa-44f9-4972-91de-ec98f924e8e5'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:28 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:17:28 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:29 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.643s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:29 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:29 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Deleted volume successfully. Jul 07 18:17:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fc3f0eeb-74b2-4f9e-9ad6-7f6a152c0022 tempest-TestServerVolumeAttachmentScenario-1927089952 None] Lock "cinder-ed7b9c21-fe9b-471c-8672-c8ac91b96219-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Acquiring lock "cinder-08b48016-be7b-4c21-b9b7-4d17c9763777-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Lock "cinder-08b48016-be7b-4c21-b9b7-4d17c9763777-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Acquiring lock "cinder-quobyte-08b48016-be7b-4c21-b9b7-4d17c9763777" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Lock "cinder-quobyte-08b48016-be7b-4c21-b9b7-4d17c9763777" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:29 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0e4ec7-a83d-4ad4-bcf0-5120fe1aa6d6]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:29 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 Jul 07 18:17:29 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:30 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777" returned: 0 in 0.811s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:30 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777 Jul 07 18:17:30 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:31 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-08b48016-be7b-4c21-b9b7-4d17c9763777" returned: 0 in 0.678s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Lock "cinder-quobyte-08b48016-be7b-4c21-b9b7-4d17c9763777" released by "delete_volume" :: held 1.545s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:31 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Created reservations ['1647a126-6285-4d52-b4e5-d672ed38fbd4', '7bc83b89-380d-4f66-88ad-57cede75679c', '82596423-1dd6-42bc-abe4-2360fcdc67db', '32c32d76-ba0d-40dd-9190-ce508a15f629'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:31 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:17:31 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:32 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.736s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:32 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:32 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Deleted volume successfully. Jul 07 18:17:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63e42f77-147d-4bd9-803f-27c13f88fcdf tempest-TestMinimumBasicScenario-124619590 None] Lock "cinder-08b48016-be7b-4c21-b9b7-4d17c9763777-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Flow 'volume_create_manager' (20bdce9f-61ad-4e56-964d-71b319178282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a180541-6fb4-4554-bc0f-cc8ea2d18d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a180541-6fb4-4554-bc0f-cc8ea2d18d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7125ae3d-9bba-459e-a4b3-0ef5e102d0d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4fc95af71264d0fbc9ee711e6bd6009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:41Z,use_quota=True,user_id='dcf5cf9ce20f4438a8d9f5dbdace58f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f2275e-7ec5-446e-ab0c-c87edecdcb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f2275e-7ec5-446e-ab0c-c87edecdcb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae21cff4-f79a-45eb-b360-46b12393e85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae21cff4-f79a-45eb-b360-46b12393e85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7125ae3d-9bba-459e-a4b3-0ef5e102d0d1', 'volume_name': 'volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5688b30e-6c58-40c9-8ee6-a4fc8d63af85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5688b30e-6c58-40c9-8ee6-a4fc8d63af85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09dd7127-a23d-4049-807d-4fd834323d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:41 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Volume 7125ae3d-9bba-459e-a4b3-0ef5e102d0d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1', 'volume_size': 1} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7125ae3d-9bba-459e-a4b3-0ef5e102d0d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4fc95af71264d0fbc9ee711e6bd6009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:41Z,use_quota=True,user_id='dcf5cf9ce20f4438a8d9f5dbdace58f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Creating volume 7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:17:41 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:17:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:41 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 1073741824 Jul 07 18:17:41 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:42 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 1073741824" returned: 0 in 0.979s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:42 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 Jul 07 18:17:42 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:42 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1" returned: 0 in 0.695s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:17:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09dd7127-a23d-4049-807d-4fd834323d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba0179b-8e06-4e4b-ab60-3bd94f822442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:42 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Volume volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 (7125ae3d-9bba-459e-a4b3-0ef5e102d0d1): created successfully Jul 07 18:17:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba0179b-8e06-4e4b-ab60-3bd94f822442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Flow 'volume_create_manager' (20bdce9f-61ad-4e56-964d-71b319178282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-371662f6-dadd-43c7-9f8d-c0df84fd74d9 tempest-CinderUnicodeTest-1517327536 None] Created volume successfully. Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Flow 'volume_create_manager' (103eb7a9-d473-47ad-a40c-9e92d3bf988c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17266eb8-b76f-4c94-ab16-43d62a7cbf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17266eb8-b76f-4c94-ab16-43d62a7cbf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1949513177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7cb720-53e4-4f0e-aed5-37c5f3048f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4fc95af71264d0fbc9ee711e6bd6009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:44Z,use_quota=True,user_id='dcf5cf9ce20f4438a8d9f5dbdace58f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b54b212-13f6-4a27-a05a-fa8e4d9b611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b54b212-13f6-4a27-a05a-fa8e4d9b611a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78cd5b2-7b7b-4c61-a746-b566c0503571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78cd5b2-7b7b-4c61-a746-b566c0503571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7cb720-53e4-4f0e-aed5-37c5f3048f72', 'volume_name': 'volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf454622-e3be-4f37-af74-28533296c58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf454622-e3be-4f37-af74-28533296c58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d33a6b1-5ed3-4aea-b77a-ce88b2f972ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:43 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Volume ff7cb720-53e4-4f0e-aed5-37c5f3048f72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72', 'volume_size': 1} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:17:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1949513177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7cb720-53e4-4f0e-aed5-37c5f3048f72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4fc95af71264d0fbc9ee711e6bd6009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:17:44Z,use_quota=True,user_id='dcf5cf9ce20f4438a8d9f5dbdace58f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Creating volume ff7cb720-53e4-4f0e-aed5-37c5f3048f72 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:17:43 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:17:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:43 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 1073741824 Jul 07 18:17:43 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:44 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 1073741824" returned: 0 in 0.931s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:44 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 Jul 07 18:17:44 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:45 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" returned: 0 in 0.722s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:17:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d33a6b1-5ed3-4aea-b77a-ce88b2f972ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3758360-7bc6-486f-b635-4f94533e0491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:17:45 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Volume volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 (ff7cb720-53e4-4f0e-aed5-37c5f3048f72): created successfully Jul 07 18:17:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3758360-7bc6-486f-b635-4f94533e0491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:17:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Flow 'volume_create_manager' (103eb7a9-d473-47ad-a40c-9e92d3bf988c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:17:45 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8221b25e-34de-4bd7-97b0-84e5ae6804eb tempest-CinderUnicodeTest-1517327536 None] Created volume successfully. Jul 07 18:17:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Creating offline snapshot 5b23ae6c-b0eb-44e3-9317-1328b5cdde4e of volume ff7cb720-53e4-4f0e-aed5-37c5f3048f72 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:17:46 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e9d31e-5e96-407d-ae3e-710502d390df]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:46 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 Jul 07 18:17:46 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:46 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" returned: 0 in 0.855s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:46 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e 1G Jul 07 18:17:46 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:47 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e 1G" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:47 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e Jul 07 18:17:47 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:48 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e" returned: 0 in 0.776s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:48 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e is being set with open permissions: ugo+rw Jul 07 18:17:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:48 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e Jul 07 18:17:48 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:49 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e" returned: 0 in 0.660s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:49 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.info Jul 07 18:17:49 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:50 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.info" returned: 0 in 0.753s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:50 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.info is being set with open permissions: ugo+rw Jul 07 18:17:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:50 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.info Jul 07 18:17:50 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:50 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.info" returned: 0 in 0.714s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.726s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:50 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c8f63468-d26d-4cf1-9997-f7c689f319ce tempest-CinderUnicodeTest-1517327536 None] Create snapshot completed successfully Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "cinder-5b23ae6c-b0eb-44e3-9317-1328b5cdde4e-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-5b23ae6c-b0eb-44e3-9317-1328b5cdde4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "cinder-quobyte-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-quobyte-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "cinder-quobyte-5b23ae6c-b0eb-44e3-9317-1328b5cdde4e" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-quobyte-5b23ae6c-b0eb-44e3-9317-1328b5cdde4e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Deleting offline snapshot 5b23ae6c-b0eb-44e3-9317-1328b5cdde4e of volume ff7cb720-53e4-4f0e-aed5-37c5f3048f72 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] snapshot_file for this snap is: volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8513b9af-450c-4324-a0f3-9a527fb86bbd]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:51 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e Jul 07 18:17:51 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:52 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e" returned: 0 in 0.793s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:17:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[50df9f28-d332-4006-a255-3d9db1aed95d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:52 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 Jul 07 18:17:52 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:53 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:53 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e Jul 07 18:17:53 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:53 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e" returned: 0 in 0.765s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:53 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e Jul 07 18:17:53 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:54 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72.5b23ae6c-b0eb-44e3-9317-1328b5cdde4e" returned: 0 in 0.750s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-quobyte-5b23ae6c-b0eb-44e3-9317-1328b5cdde4e" released by "_delete_snapshot" :: held 3.295s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-quobyte-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" released by "delete_snapshot" :: held 3.320s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:54 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Created reservations ['64dba749-89e0-4520-a92e-a244dba579ca', '63681938-7222-4caf-bc9d-9b44880acb68', '39442a5c-620e-460d-b14a-506afde6d557', '0cf828b2-74d8-4382-af7d-308664b9a4c3'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Delete snapshot completed successfully. Jul 07 18:17:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2b4f8a6c-f421-4744-905c-7eece236ca87 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-5b23ae6c-b0eb-44e3-9317-1328b5cdde4e-delete_snapshot" released by "delete_snapshot" :: held 3.464s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "cinder-ff7cb720-53e4-4f0e-aed5-37c5f3048f72-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-ff7cb720-53e4-4f0e-aed5-37c5f3048f72-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "cinder-quobyte-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-quobyte-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:55 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae5299c-9534-47ba-939d-f3085da3212c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:55 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 Jul 07 18:17:55 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:56 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" returned: 0 in 0.846s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:56 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72 Jul 07 18:17:56 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:57 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" returned: 0 in 0.714s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-quobyte-ff7cb720-53e4-4f0e-aed5-37c5f3048f72" released by "delete_volume" :: held 1.644s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Created reservations ['46c594eb-8e58-4553-8875-d21e7333a997', 'a1f9b481-8d03-4557-a51a-96fb5a4872f2', '561777ab-8838-48b7-a618-5b8c4c934a30', '280926d4-1391-4de4-bd9b-a1d498addaaa'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:57 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:17:57 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "cinder-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "cinder-quobyte-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:17:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-quobyte-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:17:58 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac81884d-439c-4f6c-8958-1850847ce215]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:17:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:58 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 Jul 07 18:17:58 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:58 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.806s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:58 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:17:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Deleted volume successfully. Jul 07 18:17:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e68d94bf-b317-4d55-a873-bc4277849549 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-ff7cb720-53e4-4f0e-aed5-37c5f3048f72-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:58 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1" returned: 0 in 0.903s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:59 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1 Jul 07 18:17:59 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:17:59 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 07 18:17:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1" returned: 0 in 0.684s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:17:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-quobyte-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1" released by "delete_volume" :: held 1.646s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:17:59 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Created reservations ['166f1c7b-54c9-4f37-b289-7fa5b81d52b3', 'fef723e6-a788-4013-ad46-5e142df49fba', '1c209022-2eb8-43a6-bfb9-161a1e81acb7', '095fc745-8919-49f2-8ee6-a8791355a3d5'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:17:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:17:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:17:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:17:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:17:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:17:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:17:59 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:17:59 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:00 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:00 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:00 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Deleted volume successfully. Jul 07 18:18:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-50ca756f-45ec-418a-8db0-0a4f12436fc2 tempest-CinderUnicodeTest-1517327536 None] Lock "cinder-7125ae3d-9bba-459e-a4b3-0ef5e102d0d1-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Flow 'volume_create_manager' (832dc4af-990b-452d-8903-7f7cd4189960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4616d428-aa18-4bc2-97ef-5f221cb37817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4616d428-aa18-4bc2-97ef-5f221cb37817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449480813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef84cdb-0511-40c2-afa6-b2ea2ca00b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07dac2c487c4beea3448dd2e474bad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:04Z,use_quota=True,user_id='441e26fe007a4e4ea68faff100e7e51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9511ab4-3a3a-4a43-9c4f-7b817df071bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9511ab4-3a3a-4a43-9c4f-7b817df071bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8fc792-2090-4ea3-9a15-fb39777f6ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8fc792-2090-4ea3-9a15-fb39777f6ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef84cdb-0511-40c2-afa6-b2ea2ca00b5e', 'volume_name': 'volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1add8b57-66f8-4c94-948a-c4c24c5c6129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1add8b57-66f8-4c94-948a-c4c24c5c6129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ec98f9-bfa2-4f69-8630-e7832ebde7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:04 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Volume bef84cdb-0511-40c2-afa6-b2ea2ca00b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e', 'volume_size': 1} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1449480813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bef84cdb-0511-40c2-afa6-b2ea2ca00b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07dac2c487c4beea3448dd2e474bad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:04Z,use_quota=True,user_id='441e26fe007a4e4ea68faff100e7e51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Creating volume bef84cdb-0511-40c2-afa6-b2ea2ca00b5e {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:18:04 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:18:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:04 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e 1073741824 Jul 07 18:18:04 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:05 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e 1073741824" returned: 0 in 0.953s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:05 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e Jul 07 18:18:05 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:06 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e" returned: 0 in 0.696s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:18:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ec98f9-bfa2-4f69-8630-e7832ebde7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f406db91-afb3-407e-a99c-aa45fc9d8383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Volume volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e (bef84cdb-0511-40c2-afa6-b2ea2ca00b5e): created successfully Jul 07 18:18:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f406db91-afb3-407e-a99c-aa45fc9d8383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Flow 'volume_create_manager' (832dc4af-990b-452d-8903-7f7cd4189960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4aaf056b-f8cd-4b5f-9fd6-ac69d1ff7ce7 tempest-ProjectReaderTests-439242896 None] Created volume successfully. Jul 07 18:18:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Acquiring lock "cinder-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Lock "cinder-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Acquiring lock "cinder-quobyte-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Lock "cinder-quobyte-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e" acquired by "delete_volume" :: waited 0.033s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:07 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c924d3b7-cfd6-4898-8244-a9ea4cfcd9aa]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:08 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e Jul 07 18:18:08 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:08 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e" returned: 0 in 0.789s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:08 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e Jul 07 18:18:08 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:09 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e" returned: 0 in 0.738s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Lock "cinder-quobyte-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e" released by "delete_volume" :: held 1.575s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:09 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Created reservations ['254a37f0-0a8f-4c0d-acc8-20d5570ccfce', '8a309b4b-92c3-4d4c-ad14-0f6a09676227', 'a538ec24-15c9-4fd3-8f49-fd94a7444e3a', 'd6967562-e470-4660-b10d-da7cc899636b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:18:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:09 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:18:09 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:10 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.714s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Deleted volume successfully. Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dff72418-6541-42c4-8990-776e80f36a20 tempest-ProjectReaderTests-439242896 None] Lock "cinder-bef84cdb-0511-40c2-afa6-b2ea2ca00b5e-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Flow 'volume_create_manager' (294574c3-0478-40cc-82b8-81faca7512a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fad9263-8c22-4ed0-b05f-12308a2b8de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fad9263-8c22-4ed0-b05f-12308a2b8de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457920038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f261394b-d2eb-4fd8-b4b1-fe48489e0dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07dac2c487c4beea3448dd2e474bad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:11Z,use_quota=True,user_id='441e26fe007a4e4ea68faff100e7e51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b20ee31-bdb4-4710-92e1-50e94e08b7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b20ee31-bdb4-4710-92e1-50e94e08b7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48294564-57d1-47a1-8350-e294deeeca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48294564-57d1-47a1-8350-e294deeeca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f261394b-d2eb-4fd8-b4b1-fe48489e0dbf', 'volume_name': 'volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef924e-f5f1-4f83-a627-92bdf4b8df66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aef924e-f5f1-4f83-a627-92bdf4b8df66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9010af4-f204-421f-98f7-6adf98fa438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:10 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Volume f261394b-d2eb-4fd8-b4b1-fe48489e0dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf', 'volume_size': 1} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-457920038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f261394b-d2eb-4fd8-b4b1-fe48489e0dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e07dac2c487c4beea3448dd2e474bad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:11Z,use_quota=True,user_id='441e26fe007a4e4ea68faff100e7e51d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Creating volume f261394b-d2eb-4fd8-b4b1-fe48489e0dbf {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:18:10 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:18:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:10 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf 1073741824 Jul 07 18:18:10 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:11 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf 1073741824" returned: 0 in 0.996s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:11 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf Jul 07 18:18:11 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:12 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf" returned: 0 in 0.657s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9010af4-f204-421f-98f7-6adf98fa438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905dffb5-be61-403d-aae3-6e67ada12ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:12 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Volume volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf (f261394b-d2eb-4fd8-b4b1-fe48489e0dbf): created successfully Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905dffb5-be61-403d-aae3-6e67ada12ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Flow 'volume_create_manager' (294574c3-0478-40cc-82b8-81faca7512a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:12 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3adab405-f8a7-4d7c-b357-17182ffa9b12 tempest-ProjectReaderTests-439242896 None] Created volume successfully. Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Acquiring lock "cinder-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Lock "cinder-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Acquiring lock "cinder-quobyte-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:12 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:18:12 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Lock "cinder-quobyte-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf5303b-ffa0-4887-bd64-0e9649793ba2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:13 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf Jul 07 18:18:13 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:13 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.684s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:18:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:18:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:18:13 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf" returned: 0 in 0.837s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:13 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf Jul 07 18:18:13 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:14 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf" returned: 0 in 0.646s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:14 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Lock "cinder-quobyte-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf" released by "delete_volume" :: held 1.536s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:14 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Created reservations ['a819130b-0f68-4d3d-89c6-33f8e6462f52', 'ebf5bc91-c2cb-4d09-a8d6-5f696ff08879', '91a02385-bb2b-40dc-b2ff-8728ee22db33', 'cdcb3e3c-4660-49c2-9cc1-105930a90a82'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:18:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:14 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:18:14 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:15 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.641s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:15 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Deleted volume successfully. Jul 07 18:18:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b191d9f8-68a5-48b3-8895-e53f6469d102 tempest-ProjectReaderTests-439242896 None] Lock "cinder-f261394b-d2eb-4fd8-b4b1-fe48489e0dbf-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:18 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:18:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Flow 'volume_create_manager' (9528a624-0a71-4742-af9f-4c982fe9937d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ce78ed-b8f0-4383-b826-78a40757e31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ce78ed-b8f0-4383-b826-78a40757e31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998202436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5624ddd-3be7-4c6a-b680-20e5862c37f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f7525fb1447b9900d0468800a63e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:19Z,use_quota=True,user_id='99f13024605e4d229986118d6b9b74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13547db1-5242-43a8-b4cb-cfff4d6b170a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13547db1-5242-43a8-b4cb-cfff4d6b170a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdab13f2-1344-4a83-a33a-c9e5d4a30b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdab13f2-1344-4a83-a33a-c9e5d4a30b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5624ddd-3be7-4c6a-b680-20e5862c37f1', 'volume_name': 'volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c795f7-9202-46b4-898b-b59b30dcb22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c795f7-9202-46b4-898b-b59b30dcb22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b017838d-4bdb-4d92-849e-343f2a9a6bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:19 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Volume c5624ddd-3be7-4c6a-b680-20e5862c37f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1', 'volume_size': 1} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998202436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5624ddd-3be7-4c6a-b680-20e5862c37f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f7525fb1447b9900d0468800a63e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:19Z,use_quota=True,user_id='99f13024605e4d229986118d6b9b74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Creating volume c5624ddd-3be7-4c6a-b680-20e5862c37f1 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:18:19 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:18:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:19 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 1073741824 Jul 07 18:18:19 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:20 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 1073741824" returned: 0 in 0.984s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:20 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 Jul 07 18:18:20 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:20 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1" returned: 0 in 0.669s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b017838d-4bdb-4d92-849e-343f2a9a6bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0880bdc9-ca78-4ab5-9e32-735d0be71ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=76,cinder:SELECT=60,cinder:INSERT=19,cinder:DELETE=7 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:18:20 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Volume volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 (c5624ddd-3be7-4c6a-b680-20e5862c37f1): created successfully Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0880bdc9-ca78-4ab5-9e32-735d0be71ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Flow 'volume_create_manager' (9528a624-0a71-4742-af9f-4c982fe9937d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-db0366d2-9237-42ea-ab4e-8f72c21cd588 tempest-ProjectReaderTests-1849745163 None] Created volume successfully. Jul 07 18:18:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Acquiring lock "cinder-c5624ddd-3be7-4c6a-b680-20e5862c37f1-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Lock "cinder-c5624ddd-3be7-4c6a-b680-20e5862c37f1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Acquiring lock "cinder-quobyte-c5624ddd-3be7-4c6a-b680-20e5862c37f1" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Lock "cinder-quobyte-c5624ddd-3be7-4c6a-b680-20e5862c37f1" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6333b4-9ba3-454d-ac91-4a6a54199422]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:21 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 Jul 07 18:18:21 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:21 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1" returned: 0 in 0.775s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:21 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1 Jul 07 18:18:21 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:22 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c5624ddd-3be7-4c6a-b680-20e5862c37f1" returned: 0 in 0.680s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Lock "cinder-quobyte-c5624ddd-3be7-4c6a-b680-20e5862c37f1" released by "delete_volume" :: held 1.509s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:22 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Created reservations ['9c2a77a6-40d9-430e-a95a-d0e26a698b6a', '712d5b0d-e7e1-402a-8069-0784dfa8904f', 'a553eb81-764a-4f6d-ae09-190bc72a9215', '062abc36-d386-4115-9c26-ebe7f091930b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:18:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:22 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:18:22 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:23 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.708s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:23 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Deleted volume successfully. Jul 07 18:18:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26ecb7d8-9f85-443d-a762-c9108a49b8b9 tempest-ProjectReaderTests-1849745163 None] Lock "cinder-c5624ddd-3be7-4c6a-b680-20e5862c37f1-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:23 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:18:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Flow 'volume_create_manager' (c6014a50-549f-4911-95cb-2638716a8aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ec1ea3-1417-4e49-8028-8f4624939439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ec1ea3-1417-4e49-8028-8f4624939439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170459446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670619c7-f04b-47eb-842e-ddb5f8b6c5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f7525fb1447b9900d0468800a63e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:24Z,use_quota=True,user_id='99f13024605e4d229986118d6b9b74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209d2588-a696-441e-9c3b-7216cf6f1a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209d2588-a696-441e-9c3b-7216cf6f1a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebaadc4-aeb0-4f98-880a-f95349440acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebaadc4-aeb0-4f98-880a-f95349440acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670619c7-f04b-47eb-842e-ddb5f8b6c5c3', 'volume_name': 'volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2abf728-f934-43c9-9394-93dc25676e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2abf728-f934-43c9-9394-93dc25676e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f42614a-c447-4266-8d36-e05224f49b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:24 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Volume 670619c7-f04b-47eb-842e-ddb5f8b6c5c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3', 'volume_size': 1} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170459446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670619c7-f04b-47eb-842e-ddb5f8b6c5c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f7525fb1447b9900d0468800a63e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:24Z,use_quota=True,user_id='99f13024605e4d229986118d6b9b74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Creating volume 670619c7-f04b-47eb-842e-ddb5f8b6c5c3 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:18:24 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:24 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 1073741824 Jul 07 18:18:24 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:24 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 1073741824" returned: 0 in 0.908s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=61,cinder:INSERT=21,cinder:UPDATE=90,cinder:DELETE=6 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:18:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:25 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 Jul 07 18:18:25 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:25 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:18:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f42614a-c447-4266-8d36-e05224f49b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64ed59c-ca71-49ec-92fd-2a117d3006db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:25 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Volume volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 (670619c7-f04b-47eb-842e-ddb5f8b6c5c3): created successfully Jul 07 18:18:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64ed59c-ca71-49ec-92fd-2a117d3006db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:25 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Flow 'volume_create_manager' (c6014a50-549f-4911-95cb-2638716a8aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:25 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-13c1cbae-6f54-4a67-b8c4-216dc61462af tempest-ProjectReaderTests-1849745163 None] Created volume successfully. Jul 07 18:18:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Acquiring lock "cinder-670619c7-f04b-47eb-842e-ddb5f8b6c5c3-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Lock "cinder-670619c7-f04b-47eb-842e-ddb5f8b6c5c3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Acquiring lock "cinder-quobyte-670619c7-f04b-47eb-842e-ddb5f8b6c5c3" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Lock "cinder-quobyte-670619c7-f04b-47eb-842e-ddb5f8b6c5c3" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:26 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fd8eec-c5aa-479c-8c5f-05f3f6b35e87]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:26 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 Jul 07 18:18:26 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:26 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3" returned: 0 in 0.785s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:26 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3 Jul 07 18:18:26 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:27 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-670619c7-f04b-47eb-842e-ddb5f8b6c5c3" returned: 0 in 0.682s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Lock "cinder-quobyte-670619c7-f04b-47eb-842e-ddb5f8b6c5c3" released by "delete_volume" :: held 1.516s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:27 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Created reservations ['9beedffc-a2c3-4850-8b7a-e391c0325c04', 'fa4cd26e-796b-4e51-a58b-080c40d5d1ea', '11490632-c136-43ec-8236-74771f7b1fae', '21685383-edd1-47f5-aef3-165257ae4977'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:18:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:27 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:18:27 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:28 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.669s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:28 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Deleted volume successfully. Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9452a845-9cdc-45a0-8bd5-f632bf2204eb tempest-ProjectReaderTests-1849745163 None] Lock "cinder-670619c7-f04b-47eb-842e-ddb5f8b6c5c3-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Flow 'volume_create_manager' (15fedd04-84ed-4387-9496-e4fbafa3f4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85c1f59-6519-483c-9940-923157c31fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85c1f59-6519-483c-9940-923157c31fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344872096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d072bd1b-1d3b-4799-9f06-2ecc43c78a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f7525fb1447b9900d0468800a63e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:29Z,use_quota=True,user_id='99f13024605e4d229986118d6b9b74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b9df9f-5d21-475c-b170-aa5389856fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b9df9f-5d21-475c-b170-aa5389856fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8255b5d8-75a5-4e0c-a130-84ffb1994b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8255b5d8-75a5-4e0c-a130-84ffb1994b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd072bd1b-1d3b-4799-9f06-2ecc43c78a78', 'volume_name': 'volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0f0e73-eeb6-4718-8b35-64d4e848e414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a0f0e73-eeb6-4718-8b35-64d4e848e414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07c93b2-68f8-4f3c-a1ff-39e60d9b7b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:28 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Volume d072bd1b-1d3b-4799-9f06-2ecc43c78a78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78', 'volume_size': 1} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344872096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d072bd1b-1d3b-4799-9f06-2ecc43c78a78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f7525fb1447b9900d0468800a63e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:29Z,use_quota=True,user_id='99f13024605e4d229986118d6b9b74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Creating volume d072bd1b-1d3b-4799-9f06-2ecc43c78a78 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:18:28 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:18:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:28 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 1073741824 Jul 07 18:18:28 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:29 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 1073741824" returned: 0 in 1.036s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:30 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 Jul 07 18:18:30 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:30 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78" returned: 0 in 0.641s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:18:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07c93b2-68f8-4f3c-a1ff-39e60d9b7b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b69e302-4b66-4b0f-9ebf-9611498f4d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:30 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Volume volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 (d072bd1b-1d3b-4799-9f06-2ecc43c78a78): created successfully Jul 07 18:18:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b69e302-4b66-4b0f-9ebf-9611498f4d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Flow 'volume_create_manager' (15fedd04-84ed-4387-9496-e4fbafa3f4ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:30 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4c10fdf6-37cb-4e94-9877-0f862eac005f tempest-ProjectReaderTests-1849745163 None] Created volume successfully. Jul 07 18:18:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Acquiring lock "cinder-d072bd1b-1d3b-4799-9f06-2ecc43c78a78-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Lock "cinder-d072bd1b-1d3b-4799-9f06-2ecc43c78a78-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Acquiring lock "cinder-quobyte-d072bd1b-1d3b-4799-9f06-2ecc43c78a78" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Lock "cinder-quobyte-d072bd1b-1d3b-4799-9f06-2ecc43c78a78" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:31 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[533b3033-d1ac-453b-ba52-b77d8157a4ea]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:31 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 Jul 07 18:18:31 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:31 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:31 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78 Jul 07 18:18:31 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:32 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d072bd1b-1d3b-4799-9f06-2ecc43c78a78" returned: 0 in 0.607s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Lock "cinder-quobyte-d072bd1b-1d3b-4799-9f06-2ecc43c78a78" released by "delete_volume" :: held 1.394s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:32 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Created reservations ['61f59ac0-2c73-4983-a789-e8f0eb4a7f33', '15f9c1f6-7e68-4775-9fe5-94983f2db729', 'e40eb722-916f-4944-a0d3-94ec4d5b24cd', 'a9cbae3f-cd54-4409-9143-94dd8c67489a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:18:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:32 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:18:32 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:33 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.677s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Deleted volume successfully. Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-594777d1-45fc-4a0a-98d4-d3d2d3a76e8a tempest-ProjectReaderTests-1849745163 None] Lock "cinder-d072bd1b-1d3b-4799-9f06-2ecc43c78a78-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Flow 'volume_create_manager' (c93eedf0-b973-47a8-880a-701a34010251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0900b1-149f-4d75-88be-f6142ccaa2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0900b1-149f-4d75-88be-f6142ccaa2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475477374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a17f3-8318-4186-8637-e747782588dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f7525fb1447b9900d0468800a63e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:34Z,use_quota=True,user_id='99f13024605e4d229986118d6b9b74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023690b6-4625-44e1-a6b8-04ead6c24e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023690b6-4625-44e1-a6b8-04ead6c24e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023044ce-81dc-460f-b357-34201d7acafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023044ce-81dc-460f-b357-34201d7acafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9a17f3-8318-4186-8637-e747782588dc', 'volume_name': 'volume-db9a17f3-8318-4186-8637-e747782588dc', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffce18fd-391e-46a4-b1d6-736624dafc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffce18fd-391e-46a4-b1d6-736624dafc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ae0a04-dbcc-4dc8-9373-1eb8589238b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:33 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Volume db9a17f3-8318-4186-8637-e747782588dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9a17f3-8318-4186-8637-e747782588dc', 'volume_size': 1} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-475477374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a17f3-8318-4186-8637-e747782588dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6f7525fb1447b9900d0468800a63e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:34Z,use_quota=True,user_id='99f13024605e4d229986118d6b9b74ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Creating volume db9a17f3-8318-4186-8637-e747782588dc {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:18:33 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:18:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:33 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc 1073741824 Jul 07 18:18:33 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:34 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc 1073741824" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:34 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc Jul 07 18:18:34 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:35 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc" returned: 0 in 0.670s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ae0a04-dbcc-4dc8-9373-1eb8589238b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9a17f3-8318-4186-8637-e747782588dc', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2d65ae-87f2-4a53-bca6-f2cf819da57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Volume volume-db9a17f3-8318-4186-8637-e747782588dc (db9a17f3-8318-4186-8637-e747782588dc): created successfully Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2d65ae-87f2-4a53-bca6-f2cf819da57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Flow 'volume_create_manager' (c93eedf0-b973-47a8-880a-701a34010251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-63fd7060-7f5d-4d89-aac6-c9973bd1372a tempest-ProjectReaderTests-1849745163 None] Created volume successfully. Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Acquiring lock "cinder-db9a17f3-8318-4186-8637-e747782588dc-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Lock "cinder-db9a17f3-8318-4186-8637-e747782588dc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Acquiring lock "cinder-quobyte-db9a17f3-8318-4186-8637-e747782588dc" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:18:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Lock "cinder-quobyte-db9a17f3-8318-4186-8637-e747782588dc" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:18:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3a3367-8a35-451e-ac6e-ba9bc1f8ab82]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:36 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc Jul 07 18:18:36 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:36 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc" returned: 0 in 0.771s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:36 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc Jul 07 18:18:36 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:37 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-db9a17f3-8318-4186-8637-e747782588dc" returned: 0 in 0.657s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Lock "cinder-quobyte-db9a17f3-8318-4186-8637-e747782588dc" released by "delete_volume" :: held 1.473s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:37 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Created reservations ['112d1641-b8ee-4ef2-bcb9-4b8de8e4d036', '250d8978-b070-4869-a848-58871c78dd51', 'e1b055e1-b825-4377-9693-6843da1ca593', 'f14ec724-c4b1-4ab0-a4ed-8cd83c0277bf'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:18:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:37 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:18:37 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:38 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.678s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:38 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:18:38 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Deleted volume successfully. Jul 07 18:18:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-b94e802a-b9e4-486f-8c1b-713a3876e068 tempest-ProjectReaderTests-1849745163 None] Lock "cinder-db9a17f3-8318-4186-8637-e747782588dc-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:18:47 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=34,cinder:SELECT=20,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:18:48 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=39,cinder:SELECT=22,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Flow 'volume_create_manager' (1cc38984-c7a2-4cb1-8bdd-59a665eca4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6b0899-d014-496e-9c05-bad930163c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6b0899-d014-496e-9c05-bad930163c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1280094202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adc51ea-08a3-45cc-8896-3bb5ba835b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a464dba8ce4a07821d1bf817999fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:51Z,use_quota=True,user_id='23cccc3d0ed34a04917c71b6c6e07a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9ee432-46e7-4fcf-920f-44b452da6cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e9ee432-46e7-4fcf-920f-44b452da6cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08653e2e-1162-4737-bed2-7b8a841e5992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08653e2e-1162-4737-bed2-7b8a841e5992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5adc51ea-08a3-45cc-8896-3bb5ba835b0a', 'volume_name': 'volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e730a9-ec6d-443f-bf9a-2dad4e8c59b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e730a9-ec6d-443f-bf9a-2dad4e8c59b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03cd7204-56f6-4360-a6fd-c066395bbb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:51 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Volume 5adc51ea-08a3-45cc-8896-3bb5ba835b0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a', 'volume_size': 1} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1280094202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adc51ea-08a3-45cc-8896-3bb5ba835b0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1a464dba8ce4a07821d1bf817999fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:18:51Z,use_quota=True,user_id='23cccc3d0ed34a04917c71b6c6e07a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Creating volume 5adc51ea-08a3-45cc-8896-3bb5ba835b0a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:18:51 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:18:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:51 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a 1073741824 Jul 07 18:18:51 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:52 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a 1073741824" returned: 0 in 0.908s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:52 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a Jul 07 18:18:52 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:52 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a" returned: 0 in 0.712s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:18:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03cd7204-56f6-4360-a6fd-c066395bbb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5481d270-454e-4cf5-a69c-f773df2d568a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:52 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Volume volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a (5adc51ea-08a3-45cc-8896-3bb5ba835b0a): created successfully Jul 07 18:18:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5481d270-454e-4cf5-a69c-f773df2d568a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Flow 'volume_create_manager' (1cc38984-c7a2-4cb1-8bdd-59a665eca4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2628d5eb-e285-44f3-a43c-64a28514db5f tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Created volume successfully. Jul 07 18:18:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-49d29069-2e16-4bac-b37d-8a0818b2c887 req-54219c5c-9fbc-4040-8cf1-b8f37fb247c9 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-49d29069-2e16-4bac-b37d-8a0818b2c887 req-54219c5c-9fbc-4040-8cf1-b8f37fb247c9 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:56 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0dfc2d-f988-4961-90b1-53f5334466e9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:18:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-49d29069-2e16-4bac-b37d-8a0818b2c887 req-54219c5c-9fbc-4040-8cf1-b8f37fb247c9 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:56 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a Jul 07 18:18:56 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:18:57 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Jul 07 18:18:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-49d29069-2e16-4bac-b37d-8a0818b2c887 req-54219c5c-9fbc-4040-8cf1-b8f37fb247c9 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a" returned: 0 in 0.844s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:18:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-49d29069-2e16-4bac-b37d-8a0818b2c887 req-54219c5c-9fbc-4040-8cf1-b8f37fb247c9 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.861s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-49d29069-2e16-4bac-b37d-8a0818b2c887 req-54219c5c-9fbc-4040-8cf1-b8f37fb247c9 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89abce93-dd8e-4006-ae12-0b753f70579e', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:18:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-49d29069-2e16-4bac-b37d-8a0818b2c887 req-54219c5c-9fbc-4040-8cf1-b8f37fb247c9 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] attachment_update completed successfully. Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Flow 'volume_create_manager' (65356feb-0ded-4173-84c3-041cf0096c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc279de3-8a73-4e26-a014-7efb940a4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc279de3-8a73-4e26-a014-7efb940a4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1874001609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed64fcf5-b9c1-4d71-91ca-fed9096bc841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a773ddc53047f4a4768294195766cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:19:00Z,use_quota=True,user_id='02645da743e442ae9ccdbf82ce4cfaff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8d2317-8f70-418c-92de-51dbddf0c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8d2317-8f70-418c-92de-51dbddf0c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b1abba-0a00-48f2-8c94-c04c59e789fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60b1abba-0a00-48f2-8c94-c04c59e789fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed64fcf5-b9c1-4d71-91ca-fed9096bc841', 'volume_name': 'volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9c2410-53e8-43ea-829b-f971f8b85b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9c2410-53e8-43ea-829b-f971f8b85b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899d83a9-bd57-45e8-90a5-d45d9a09d73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:18:59 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Volume ed64fcf5-b9c1-4d71-91ca-fed9096bc841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841', 'volume_size': 1} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1874001609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed64fcf5-b9c1-4d71-91ca-fed9096bc841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a773ddc53047f4a4768294195766cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:19:00Z,use_quota=True,user_id='02645da743e442ae9ccdbf82ce4cfaff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Creating volume ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:18:59 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:18:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:18:59 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 1073741824 Jul 07 18:18:59 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:00 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 1073741824" returned: 0 in 0.866s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:00 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 Jul 07 18:19:00 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:01 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" returned: 0 in 0.642s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:19:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:19:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899d83a9-bd57-45e8-90a5-d45d9a09d73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:19:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a4b30d-1b79-45f8-817e-89d6aa064e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:19:01 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Volume volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 (ed64fcf5-b9c1-4d71-91ca-fed9096bc841): created successfully Jul 07 18:19:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a4b30d-1b79-45f8-817e-89d6aa064e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:19:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Flow 'volume_create_manager' (65356feb-0ded-4173-84c3-041cf0096c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:19:01 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-488989bf-bbf0-4569-a55d-e946a52ac5ae tempest-SnapshotDependencyTests-647977729 None] Created volume successfully. Jul 07 18:19:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:19:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:19:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Creating offline snapshot 92b7202b-6fb9-41c8-8de9-d3f790a39dd5 of volume ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:19:02 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0deacfc-cf30-4abf-975a-50b228e18eb7]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:19:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:02 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 Jul 07 18:19:02 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:02 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" returned: 0 in 0.784s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:02 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 1G Jul 07 18:19:02 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:03 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 1G" returned: 0 in 0.850s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:03 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 Jul 07 18:19:03 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:04 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5" returned: 0 in 0.738s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:04 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 is being set with open permissions: ugo+rw Jul 07 18:19:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:04 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 Jul 07 18:19:04 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-0e80b579-e72c-4027-88e0-d3e745d3528d req-d739eb80-f70c-4da9-ba0b-1361616769f4 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Terminate volume connection completed successfully. Jul 07 18:19:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-0e80b579-e72c-4027-88e0-d3e745d3528d req-d739eb80-f70c-4da9-ba0b-1361616769f4 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Deleting attachment 89abce93-dd8e-4006-ae12-0b753f70579e. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:19:05 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5" returned: 0 in 0.699s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:05 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.info Jul 07 18:19:05 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:05 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.info" returned: 0 in 0.680s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:05 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.info is being set with open permissions: ugo+rw Jul 07 18:19:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:05 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.info Jul 07 18:19:05 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:06 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.info" returned: 0 in 0.647s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.482s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:19:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-55265298-b193-4133-89d2-5976f5c4bf93 tempest-SnapshotDependencyTests-647977729 None] Create snapshot completed successfully Jul 07 18:19:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Acquiring lock "cinder-5adc51ea-08a3-45cc-8896-3bb5ba835b0a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "cinder-5adc51ea-08a3-45cc-8896-3bb5ba835b0a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Acquiring lock "cinder-quobyte-5adc51ea-08a3-45cc-8896-3bb5ba835b0a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "cinder-quobyte-5adc51ea-08a3-45cc-8896-3bb5ba835b0a" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:06 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc614ae0-7213-40ec-9527-aa97c0b4d40d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:19:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:06 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a Jul 07 18:19:06 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:07 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a" returned: 0 in 0.780s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:07 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a Jul 07 18:19:07 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Flow 'volume_create_manager' (81ded7a9-d181-494c-b41e-b7c9bc6635d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45683fb1-c6d1-4e0b-9bee-d4b97f70c3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45683fb1-c6d1-4e0b-9bee-d4b97f70c3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc93322-8a92-4116-bae3-ec8a985eed9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79a773ddc53047f4a4768294195766cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92b7202b-6fb9-41c8-8de9-d3f790a39dd5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:19:08Z,use_quota=True,user_id='02645da743e442ae9ccdbf82ce4cfaff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbf47f0-5999-4f9e-8dda-f71aeb11f030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bbf47f0-5999-4f9e-8dda-f71aeb11f030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1631e21d-26d8-42db-87d5-1a656bfe11f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1631e21d-26d8-42db-87d5-1a656bfe11f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9bc93322-8a92-4116-bae3-ec8a985eed9f', 'volume_name': 'volume-9bc93322-8a92-4116-bae3-ec8a985eed9f', 'volume_size': 1, 'snapshot_id': '92b7202b-6fb9-41c8-8de9-d3f790a39dd5'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cfae34-0d3a-4dd8-b634-e1f999dbacc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cfae34-0d3a-4dd8-b634-e1f999dbacc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882169cc-dd85-46e0-98f1-13d6ef8fd1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:19:07 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Volume 9bc93322-8a92-4116-bae3-ec8a985eed9f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9bc93322-8a92-4116-bae3-ec8a985eed9f', 'volume_size': 1, 'snapshot_id': '92b7202b-6fb9-41c8-8de9-d3f790a39dd5'} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:19:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "cinder-quobyte-92b7202b-6fb9-41c8-8de9-d3f790a39dd5-9bc93322-8a92-4116-bae3-ec8a985eed9f" by "_create_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-92b7202b-6fb9-41c8-8de9-d3f790a39dd5-9bc93322-8a92-4116-bae3-ec8a985eed9f" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Creating volume 9bc93322-8a92-4116-bae3-ec8a985eed9f from snapshot 92b7202b-6fb9-41c8-8de9-d3f790a39dd5 {{(pid=86972) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "cinder-quobyte-9bc93322-8a92-4116-bae3-ec8a985eed9f" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-9bc93322-8a92-4116-bae3-ec8a985eed9f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] snapshot: 92b7202b-6fb9-41c8-8de9-d3f790a39dd5, volume: 9bc93322-8a92-4116-bae3-ec8a985eed9f, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0f81db-4ea8-4f8f-a369-8e95109317b0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:08 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 Jul 07 18:19:08 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:08 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5adc51ea-08a3-45cc-8896-3bb5ba835b0a" returned: 0 in 0.706s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "cinder-quobyte-5adc51ea-08a3-45cc-8896-3bb5ba835b0a" released by "delete_volume" :: held 1.524s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Created reservations ['6d1d3aaa-ea46-43ef-bfca-021cdc8af42d', 'fc33248c-f478-40e9-8142-7b11135e72b6', 'd0f2a2bd-c318-4953-b085-c9d083f860f8', 'f46e2742-e28a-4320-9a5f-cadc616fd3bf'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:08 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:19:08 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:08 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5" returned: 0 in 0.823s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c71cae-bdea-45da-a8cd-33524053e494]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:19:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:09 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 Jul 07 18:19:09 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:09 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.794s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:09 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:19:09 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Deleted volume successfully. Jul 07 18:19:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21cb702f-f64c-4063-a014-2208006a8d43 tempest-TestServerVolumeAttachScenarioOldVersion-1936914983 None] Lock "cinder-5adc51ea-08a3-45cc-8896-3bb5ba835b0a-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:09 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" returned: 0 in 0.794s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:09 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:19:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:09 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f Jul 07 18:19:09 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:19:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:19:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:19:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:19:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:19:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:19:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:12 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:19:12 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:14 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.895s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:14 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:19:14 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:19:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:19:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:19:15 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f" returned: 0 in 5.642s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:15 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1c1a9c-d8cc-4c1b-92ce-914955c068ad]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:19:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:15 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 Jul 07 18:19:15 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:16 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" returned: 0 in 0.926s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:16 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:19:16 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Converted 1024.00 MB image at 181.48 MB/s Jul 07 18:19:16 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f is being set with open permissions: ugo+rw Jul 07 18:19:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:16 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f Jul 07 18:19:16 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:16 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f" returned: 0 in 0.645s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-9bc93322-8a92-4116-bae3-ec8a985eed9f" released by "_copy_volume_from_snapshot" :: held 8.929s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-92b7202b-6fb9-41c8-8de9-d3f790a39dd5-9bc93322-8a92-4116-bae3-ec8a985eed9f" released by "_create_volume_from_snapshot" :: held 8.962s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.978s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:19:16 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (882169cc-dd85-46e0-98f1-13d6ef8fd1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc93322-8a92-4116-bae3-ec8a985eed9f', 'volume_size': 1, 'snapshot_id': '92b7202b-6fb9-41c8-8de9-d3f790a39dd5'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:19:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2cdfba-4219-4034-acd8-43b64c650272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:19:17 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Volume volume-9bc93322-8a92-4116-bae3-ec8a985eed9f (9bc93322-8a92-4116-bae3-ec8a985eed9f): created successfully Jul 07 18:19:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2cdfba-4219-4034-acd8-43b64c650272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:19:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Flow 'volume_create_manager' (81ded7a9-d181-494c-b41e-b7c9bc6635d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:19:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-42c37d19-0cc3-4f0e-9931-ea649da4ee0d tempest-SnapshotDependencyTests-647977729 None] Created volume successfully. Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "cinder-92b7202b-6fb9-41c8-8de9-d3f790a39dd5-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-92b7202b-6fb9-41c8-8de9-d3f790a39dd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "cinder-quobyte-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "cinder-quobyte-92b7202b-6fb9-41c8-8de9-d3f790a39dd5" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-92b7202b-6fb9-41c8-8de9-d3f790a39dd5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Deleting offline snapshot 92b7202b-6fb9-41c8-8de9-d3f790a39dd5 of volume ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] snapshot_file for this snap is: volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab97534f-4ef4-4b27-95f3-900f2187bb06]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:18 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 Jul 07 18:19:18 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:18 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5" returned: 0 in 0.784s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1552ddad-2642-4148-bbd4-3c61413e15ef]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:19:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:19 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 Jul 07 18:19:19 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:19 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" returned: 0 in 0.811s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:19 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 Jul 07 18:19:19 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:20 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5" returned: 0 in 0.806s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:20 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5 Jul 07 18:19:20 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:21 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841.92b7202b-6fb9-41c8-8de9-d3f790a39dd5" returned: 0 in 0.705s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-92b7202b-6fb9-41c8-8de9-d3f790a39dd5" released by "_delete_snapshot" :: held 3.216s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" released by "delete_snapshot" :: held 3.240s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:21 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Created reservations ['c0eae5c7-6356-475b-a9a6-464815cc7286', 'ea64dc82-5d98-4345-b864-fb06512a9a1b', '80e20c09-ed10-4ebf-aba4-4fd1f90b3f08', 'be5e542d-7a8d-4ef4-b455-eb13c996328b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:19:21 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Delete snapshot completed successfully. Jul 07 18:19:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-5307b15d-60a0-401d-8719-188b363aa447 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-92b7202b-6fb9-41c8-8de9-d3f790a39dd5-delete_snapshot" released by "delete_snapshot" :: held 3.385s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "cinder-ed64fcf5-b9c1-4d71-91ca-fed9096bc841-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-ed64fcf5-b9c1-4d71-91ca-fed9096bc841-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "cinder-quobyte-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:22 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54e5b97-17e1-488a-b037-6412a15b055f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:19:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:22 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 Jul 07 18:19:22 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:23 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" returned: 0 in 0.793s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:23 devstack sudo[102618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841 Jul 07 18:19:23 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:23 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" returned: 0 in 0.663s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-ed64fcf5-b9c1-4d71-91ca-fed9096bc841" released by "delete_volume" :: held 1.521s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:23 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Created reservations ['14318cbb-a948-4791-8938-64225daa72e7', 'a4ee6d42-bd32-47ea-a3b8-592f2854c799', 'c43642b5-1a2f-45e5-b042-21c8ac8c5ccd', '4b1fe52f-4d84-412c-a554-5ff15a14cc0b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:24 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:19:24 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "cinder-9bc93322-8a92-4116-bae3-ec8a985eed9f-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-9bc93322-8a92-4116-bae3-ec8a985eed9f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "cinder-quobyte-9bc93322-8a92-4116-bae3-ec8a985eed9f" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-9bc93322-8a92-4116-bae3-ec8a985eed9f" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e87b0a-3dc3-4428-b27f-200374f8993b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:24 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.727s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:19:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Deleted volume successfully. Jul 07 18:19:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c9e8f865-a8a4-4987-a005-68b1ea4cb7b1 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-ed64fcf5-b9c1-4d71-91ca-fed9096bc841-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:24 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f Jul 07 18:19:24 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:25 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f" returned: 0 in 0.809s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:25 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f Jul 07 18:19:25 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:26 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9bc93322-8a92-4116-bae3-ec8a985eed9f" returned: 0 in 0.822s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-quobyte-9bc93322-8a92-4116-bae3-ec8a985eed9f" released by "delete_volume" :: held 1.688s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:26 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Created reservations ['4f17b664-63a2-4b46-9c8f-539d0fef4772', '53c93930-f659-4688-9ca3-e6cf6a2d507a', '2f0a9319-c6e0-453c-a67a-bd0327c480ae', '14068e18-7e16-4df4-a81f-ecbc321e4e13'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:19:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:19:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:19:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:19:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:19:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:19:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:19:26 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:19:26 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:19:27 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 07 18:19:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.757s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:19:27 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:19:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Deleted volume successfully. Jul 07 18:19:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dbc22357-f212-4a07-aa20-d47282f5edb5 tempest-SnapshotDependencyTests-647977729 None] Lock "cinder-9bc93322-8a92-4116-bae3-ec8a985eed9f-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:19:36 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=46,cinder:DELETE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:19:37 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=35,cinder:SELECT=40,cinder:DELETE=6,cinder:INSERT=9 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Flow 'volume_create_manager' (6649f48b-6cc1-4366-aff7-6acc00dab014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f297b86-372f-4b81-a21c-a6a7c63b1d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f297b86-372f-4b81-a21c-a6a7c63b1d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-677521477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4572f1-176d-4ef8-a8d0-b632e95d1c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c024a6e1f94ea7be9cf064a38c1589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:20:00Z,use_quota=True,user_id='9a4be39a790a489f95a0fc8af37a8332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cf965d-84cf-45b1-87b5-5aae53dd07bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cf965d-84cf-45b1-87b5-5aae53dd07bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0575bfd6-3599-4bce-b7a3-a724315f5913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.image.glance [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Creating Keystone auth plugin from conf {{(pid=86972) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0575bfd6-3599-4bce-b7a3-a724315f5913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b4572f1-176d-4ef8-a8d0-b632e95d1c9f', 'volume_name': 'volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24191bd6-6919-47de-9a23-7ab8709f9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24191bd6-6919-47de-9a23-7ab8709f9093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbe1ca6-6fbe-48fc-bb81-1a3cedbb7caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:20:00 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Volume 9b4572f1-176d-4ef8-a8d0-b632e95d1c9f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 18:20:00 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Trying to clone 9b4572f1-176d-4ef8-a8d0-b632e95d1c9f from image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]). {{(pid=86972) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 18:20:01 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:20:01 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Image download 20.69 MB at 20.69 MB/s Jul 07 18:20:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2788fd1a-70b7-481a-b72c-2b5804b55a03]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:20:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:01 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD Jul 07 18:20:01 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:01 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:20:01 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD" returned: 0 in 0.800s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:01 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Temporary image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 is fetched for user 9a4be39a790a489f95a0fc8af37a8332. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c533f2be-3c8a-4118-888e-245dc550aeec]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:02 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD Jul 07 18:20:02 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:02 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD" returned: 0 in 0.805s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-677521477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4572f1-176d-4ef8-a8d0-b632e95d1c9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c024a6e1f94ea7be9cf064a38c1589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:20:00Z,use_quota=True,user_id='9a4be39a790a489f95a0fc8af37a8332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Creating volume 9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:20:02 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:20:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:02 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f 1073741824 Jul 07 18:20:02 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:03 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f 1073741824" returned: 0 in 0.889s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:03 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:20:03 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:04 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 0 in 0.633s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:20:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:20:04 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Attempting download of 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}])) to volume 9b4572f1-176d-4ef8-a8d0-b632e95d1c9f. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:20:04 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[103a383f-ebcc-43e3-97e7-21e9961c5cd2]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:20:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yz61byuo {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:04 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yz61byuo Jul 07 18:20:04 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:05 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yz61byuo" returned: 0 in 0.769s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yz61byuo {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:05 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yz61byuo Jul 07 18:20:05 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:05 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yz61byuo" returned: 1 in 0.706s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_yz61byuo' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:20:05 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0546c574-d7e9-4a5b-b16c-33dd58f49965]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:20:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:06 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD Jul 07 18:20:06 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:06 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD" returned: 0 in 0.722s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:06 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 was qcow2, converting to raw {{(pid=86972) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:20:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:06 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:20:06 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:08 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 0 in 1.919s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:08 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950_i8l_qv83devstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:20:08 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Converted 112.00 MB image at 58.32 MB/s Jul 07 18:20:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:08 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f 1G Jul 07 18:20:08 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:09 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f 1G" returned: 0 in 0.724s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:09 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[197904da-f1b1-4696-ae89-c57c3d2a647b]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:20:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:09 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:20:09 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:10 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 0 in 0.797s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:10 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:20:10 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:10 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 1 in 0.744s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:20:10 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Downloaded image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}])) to volume 9b4572f1-176d-4ef8-a8d0-b632e95d1c9f successfully. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:20:10 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Temporary image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 for user 9a4be39a790a489f95a0fc8af37a8332 is deleted. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:20:10 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Marking volume 9b4572f1-176d-4ef8-a8d0-b632e95d1c9f as bootable. {{(pid=86972) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:20:10 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Copying metadata from image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 to 9b4572f1-176d-4ef8-a8d0-b632e95d1c9f. {{(pid=86972) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:20:10 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Creating volume glance metadata for volume 9b4572f1-176d-4ef8-a8d0-b632e95d1c9f backed by image 4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86972) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:20:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbe1ca6-6fbe-48fc-bb81-1a3cedbb7caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f', 'volume_size': 1, 'image_id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e19d177ef1604a8583371038318e3166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950', 'created_at': datetime.datetime(2026, 7, 7, 15, 53, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 15, 53, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dbe5bb0-0c4d-4f1d-b8e3-46413b8cf950/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:20:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3874ad6-668b-4be1-97b8-adb4bac96553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:20:11 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Volume volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f (9b4572f1-176d-4ef8-a8d0-b632e95d1c9f): created successfully Jul 07 18:20:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3874ad6-668b-4be1-97b8-adb4bac96553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:20:11 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Flow 'volume_create_manager' (6649f48b-6cc1-4366-aff7-6acc00dab014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:20:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1ea39ef3-3446-458d-97d4-621f8d97b0a8 tempest-TestShelveInstance-1400897581 None] Created volume successfully. Jul 07 18:20:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:20:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:20:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:20:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:20:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:20:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:20:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:12 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:20:12 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:13 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.730s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:20:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:20:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:20:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:20:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:20:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:20:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3d5294-24cd-43d5-b63e-f4e28931dbbc]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:20:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:19 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:20:19 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:19 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 0 in 0.810s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:20:19 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:20:19 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:20:20 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Jul 07 18:20:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 1 in 0.745s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:20:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:20:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.596s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:20:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70f501d4-cc3c-4ea0-a17c-f8477f10eeec', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:20:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-60ccb452-023e-4df0-9d02-a4352813694e req-1d41cec9-94ac-42d3-8a9a-e9112fbb7293 tempest-TestShelveInstance-1400897581 None] attachment_update completed successfully. Jul 07 18:20:30 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=16,cinder:UPDATE=6,cinder:INSERT=5 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:20:30 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:INSERT=9,cinder:DELETE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:20:56 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-28bf83a3-6620-499f-8eb0-2a1175a72151 req-69485650-4397-47fa-a610-444cab57b831 tempest-TestShelveInstance-1400897581 None] Terminate volume connection completed successfully. Jul 07 18:20:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-28bf83a3-6620-499f-8eb0-2a1175a72151 req-69485650-4397-47fa-a610-444cab57b831 tempest-TestShelveInstance-1400897581 None] Deleting attachment 70f501d4-cc3c-4ea0-a17c-f8477f10eeec. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:21:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:21:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:21:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8940b5b0-6078-41d6-a315-b4288f55c986]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:21:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:01 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:21:01 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:02 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 0 in 0.740s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:02 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:21:02 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:03 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 1 in 0.753s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:21:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.534s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:21:03 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260', 'name': 'volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acb0c6ae-bbfa-47a0-8477-043c2faadd72', 'enforce_multipath': True} {{(pid=86972) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 07 18:21:03 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-7508b218-908d-4478-acd0-b29138bbbe66 req-14432f72-a7c3-4801-943f-b91ab3982f84 tempest-TestShelveInstance-1400897581 None] attachment_update completed successfully. Jul 07 18:21:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:21:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:21:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:21:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:21:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:21:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:21:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:12 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:21:12 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:13 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:21:13 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:21:13 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.704s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:21:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:21:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:21:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:21:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-b0f680c5-a222-4d37-b8b9-531f62880559 tempest-TestShelveInstance-1400897581 None] Terminate volume connection completed successfully. Jul 07 18:21:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-b0f680c5-a222-4d37-b8b9-531f62880559 tempest-TestShelveInstance-1400897581 None] Deleting attachment acb0c6ae-bbfa-47a0-8477-043c2faadd72. {{(pid=86972) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 07 18:21:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Acquiring lock "cinder-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:21:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Lock "cinder-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:21:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Acquiring lock "cinder-quobyte-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:21:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Lock "cinder-quobyte-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:21:42 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[711f03ec-a4ba-4db5-a31e-1fb652d3bcda]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:21:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:42 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:21:42 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:43 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 0 in 0.821s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:43 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:21:43 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:44 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 1 in 0.773s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:21:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:44 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f Jul 07 18:21:44 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:45 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" returned: 0 in 0.663s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Lock "cinder-quobyte-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f" released by "delete_volume" :: held 2.326s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG cinder.quota [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Created reservations ['c21ef846-9671-40ae-a781-e66ac42d198d', '04f84735-0d30-4719-8b76-4e266b62a27c', '11c86438-0f6b-407d-9778-49edd123d683', '2aa49115-1c16-43bf-b9db-8cdfe7f18322'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:45 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:21:45 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:45 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.752s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:45 devstack cinder-volume[86972]: DEBUG cinder.manager [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:21:46 devstack cinder-volume[86972]: INFO cinder.volume.manager [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Deleted volume successfully. Jul 07 18:21:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [req-98bb0ecb-3d9d-4086-a89f-ed2cb639f336 req-a9306711-c7a0-407e-9647-ccab3c5fdc71 tempest-TestShelveInstance-1400897581 None] Lock "cinder-9b4572f1-176d-4ef8-a8d0-b632e95d1c9f-delete_volume" released by "delete_volume" :: held 3.294s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (b9e711ae-f10a-4616-aa7d-801b51f89a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c06386-a312-4aed-8c3f-67c40527352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c06386-a312-4aed-8c3f-67c40527352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1339004463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6071e1-6b92-43d0-b244-c8add9c24b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:21:56Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c1abd5-84b3-4715-b287-0da8cda6e657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c1abd5-84b3-4715-b287-0da8cda6e657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8363ec2f-487d-459f-8d63-1f792cd8ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8363ec2f-487d-459f-8d63-1f792cd8ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd6071e1-6b92-43d0-b244-c8add9c24b8e', 'volume_name': 'volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe01bd4-db28-4e48-9ab8-5cce8d705177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe01bd4-db28-4e48-9ab8-5cce8d705177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48a0d14-462f-43f1-98e4-0c1fbd355dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:21:56 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume fd6071e1-6b92-43d0-b244-c8add9c24b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e', 'volume_size': 1} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1339004463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd6071e1-6b92-43d0-b244-c8add9c24b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:21:56Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Creating volume fd6071e1-6b92-43d0-b244-c8add9c24b8e {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:21:56 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:21:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:56 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e 1073741824 Jul 07 18:21:56 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:57 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e 1073741824" returned: 0 in 0.806s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:57 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e Jul 07 18:21:57 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:57 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e" returned: 0 in 0.628s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:21:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:21:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a48a0d14-462f-43f1-98e4-0c1fbd355dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:21:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369e896d-15ee-44a8-8ba0-df456178ecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:21:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e (fd6071e1-6b92-43d0-b244-c8add9c24b8e): created successfully Jul 07 18:21:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (369e896d-15ee-44a8-8ba0-df456178ecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:21:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (b9e711ae-f10a-4616-aa7d-801b51f89a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:21:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dd7a8d45-c173-408d-8328-0bec958197f7 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created volume successfully. Jul 07 18:21:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:21:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:21:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Creating offline snapshot a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 of volume fd6071e1-6b92-43d0-b244-c8add9c24b8e {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:21:58 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcdeb9a-7641-414a-aaf4-5b139b3e9422]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:21:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:58 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e Jul 07 18:21:58 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:59 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e" returned: 0 in 0.720s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:59 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 1G Jul 07 18:21:59 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:21:59 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Jul 07 18:21:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 1G" returned: 0 in 0.766s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:21:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:21:59 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 Jul 07 18:21:59 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:00 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:00 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 is being set with open permissions: ugo+rw Jul 07 18:22:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:00 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 Jul 07 18:22:00 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:01 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02" returned: 0 in 0.631s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:01 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.info Jul 07 18:22:01 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:01 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.info" returned: 0 in 0.616s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:01 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.info is being set with open permissions: ugo+rw Jul 07 18:22:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:01 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.info Jul 07 18:22:01 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:02 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.info" returned: 0 in 0.610s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.119s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:02 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-7f2b05ed-2bc9-49d8-80f0-726cfe7895f4 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Create snapshot completed successfully Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (16c7f4d0-ef63-4e9a-8d8b-3ac8081b0315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d173b2-8f04-4401-8382-d739bc515cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d173b2-8f04-4401-8382-d739bc515cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-41572515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1365894-5df9-4e06-b1ff-20c99f092fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:04Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e429a017-4e76-42e3-9567-7129803ed2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e429a017-4e76-42e3-9567-7129803ed2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce7aeb4-8391-4265-98a7-acef40754cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce7aeb4-8391-4265-98a7-acef40754cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1365894-5df9-4e06-b1ff-20c99f092fc1', 'volume_name': 'volume-b1365894-5df9-4e06-b1ff-20c99f092fc1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9744fc14-a624-42ac-8569-4b15a28ca9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9744fc14-a624-42ac-8569-4b15a28ca9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fd795d-e284-49f8-9e15-912a63f8a299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume b1365894-5df9-4e06-b1ff-20c99f092fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1365894-5df9-4e06-b1ff-20c99f092fc1', 'volume_size': 1} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-41572515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1365894-5df9-4e06-b1ff-20c99f092fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:04Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Creating volume b1365894-5df9-4e06-b1ff-20c99f092fc1 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:04 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:04 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 1073741824 Jul 07 18:22:04 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (a05fa009-035b-4fbc-8191-4349aaffbbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4788a342-b662-45b2-b498-050e75b2e2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4788a342-b662-45b2-b498-050e75b2e2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639602076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393dc30b-de45-4c12-9d01-2405a59f8d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:04Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd044159-892f-4ae5-ba56-03c41d799f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd044159-892f-4ae5-ba56-03c41d799f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21eff715-c1b6-4db0-91a1-f95be8e2525e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21eff715-c1b6-4db0-91a1-f95be8e2525e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393dc30b-de45-4c12-9d01-2405a59f8d1a', 'volume_name': 'volume-393dc30b-de45-4c12-9d01-2405a59f8d1a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7ea724-d5a6-4b62-8f98-03d26f1534d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7ea724-d5a6-4b62-8f98-03d26f1534d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ec6810-daf2-4c6f-98ce-4b11ec838a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume 393dc30b-de45-4c12-9d01-2405a59f8d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393dc30b-de45-4c12-9d01-2405a59f8d1a', 'volume_size': 1} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (88e86690-5d34-4e85-b092-7a9e55ff2c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19df07-82f6-4ce4-ab73-aa07d5386f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb19df07-82f6-4ce4-ab73-aa07d5386f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147403929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:05Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67252832-c2fc-4dce-bfa5-2ccb2c870f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67252832-c2fc-4dce-bfa5-2ccb2c870f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d44084-e5fe-4c07-8d23-2d2dee81931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d44084-e5fe-4c07-8d23-2d2dee81931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581', 'volume_name': 'volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b169323-7045-439f-a28c-6c9261804cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b169323-7045-439f-a28c-6c9261804cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb507b35-cf55-4c0c-a1f6-90e1d766c6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:04 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581', 'volume_size': 1} Jul 07 18:22:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:05 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 1073741824" returned: 0 in 0.950s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:05 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 Jul 07 18:22:05 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (38701d26-d413-4f88-a58d-02ddaf57f06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedc5233-7bb1-4166-b6eb-8be0f10ae303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedc5233-7bb1-4166-b6eb-8be0f10ae303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-510213209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a66a584-63f6-40ef-9a8d-06f6f80c44c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:05Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b82458-22cf-4878-a4cc-eae789e356cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b82458-22cf-4878-a4cc-eae789e356cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d77b99-5f85-4213-90d6-b3b1fc4b46bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d77b99-5f85-4213-90d6-b3b1fc4b46bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a66a584-63f6-40ef-9a8d-06f6f80c44c7', 'volume_name': 'volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb032d8c-03c7-4e48-864e-2098cb78b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb032d8c-03c7-4e48-864e-2098cb78b92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d83fe82-515c-4191-9abe-64a729e72679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume 1a66a584-63f6-40ef-9a8d-06f6f80c44c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7', 'volume_size': 1} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (531794dd-c609-426d-affc-202179190253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d6d7a6-28a0-46b3-a0a7-d94af9747426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d6d7a6-28a0-46b3-a0a7-d94af9747426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-916184384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdaa5ef-432f-4ada-bd80-71fdeafe1021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:06Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba6c3fd-767f-4ab4-a190-7449981d2eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba6c3fd-767f-4ab4-a190-7449981d2eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c04632-00a3-49d1-84f0-19276877a4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c04632-00a3-49d1-84f0-19276877a4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bdaa5ef-432f-4ada-bd80-71fdeafe1021', 'volume_name': 'volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba25682-d0ad-43f2-8fb3-4598b410c144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba25682-d0ad-43f2-8fb3-4598b410c144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0cae23-5e8e-4156-8686-b37aea001b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume 8bdaa5ef-432f-4ada-bd80-71fdeafe1021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021', 'volume_size': 1} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:05 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1" returned: 0 in 0.713s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1639602076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393dc30b-de45-4c12-9d01-2405a59f8d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:04Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Creating volume 393dc30b-de45-4c12-9d01-2405a59f8d1a {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:05 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:05 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a 1073741824 Jul 07 18:22:05 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fd795d-e284-49f8-9e15-912a63f8a299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1365894-5df9-4e06-b1ff-20c99f092fc1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b92f25-fcf2-4527-82e5-17a90ecc7285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:05 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 (b1365894-5df9-4e06-b1ff-20c99f092fc1): created successfully Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b92f25-fcf2-4527-82e5-17a90ecc7285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (16c7f4d0-ef63-4e9a-8d8b-3ac8081b0315) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:05 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-20339e25-fb5c-4e21-8c2c-56a22e101f7b tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created volume successfully. Jul 07 18:22:06 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a 1073741824" returned: 0 in 0.826s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:06 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a Jul 07 18:22:06 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:07 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a" returned: 0 in 0.609s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.377s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147403929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:05Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Creating volume fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:07 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ec6810-daf2-4c6f-98ce-4b11ec838a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393dc30b-de45-4c12-9d01-2405a59f8d1a', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:07 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 1073741824 Jul 07 18:22:07 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd7da4d-453f-45dd-81d2-c71330fe36ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:07 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume volume-393dc30b-de45-4c12-9d01-2405a59f8d1a (393dc30b-de45-4c12-9d01-2405a59f8d1a): created successfully Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd7da4d-453f-45dd-81d2-c71330fe36ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (a05fa009-035b-4fbc-8191-4349aaffbbd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5dd67892-fcc7-4d4a-9d3e-ed5173a9956a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created volume successfully. Jul 07 18:22:08 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 1073741824" returned: 0 in 0.824s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:08 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 Jul 07 18:22:08 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:08 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581" returned: 0 in 0.655s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.509s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-510213209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a66a584-63f6-40ef-9a8d-06f6f80c44c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:05Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Creating volume 1a66a584-63f6-40ef-9a8d-06f6f80c44c7 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:08 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:08 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 1073741824 Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb507b35-cf55-4c0c-a1f6-90e1d766c6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:08 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1223a75-2cfe-4ae7-a54e-58783606dd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:08 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 (fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581): created successfully Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1223a75-2cfe-4ae7-a54e-58783606dd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (88e86690-5d34-4e85-b092-7a9e55ff2c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-218b5795-fcf2-41ac-b015-d446ab4161a0 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created volume successfully. Jul 07 18:22:09 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 1073741824" returned: 0 in 0.880s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:09 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 Jul 07 18:22:09 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:10 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7" returned: 0 in 0.691s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.814s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-916184384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bdaa5ef-432f-4ada-bd80-71fdeafe1021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c641a14439bc4a3b970f21c72d62d8b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:06Z,use_quota=True,user_id='c38cb04d5c684cd4a844b4d30b42d30d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Creating volume 8bdaa5ef-432f-4ada-bd80-71fdeafe1021 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:10 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d83fe82-515c-4191-9abe-64a729e72679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:10 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 1073741824 Jul 07 18:22:10 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0c2b59-a5db-4adc-8eda-faa781cb2060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:10 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 (1a66a584-63f6-40ef-9a8d-06f6f80c44c7): created successfully Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0c2b59-a5db-4adc-8eda-faa781cb2060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (38701d26-d413-4f88-a58d-02ddaf57f06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-7055efaa-2976-4a48-b2d6-8be35a7fd74f tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created volume successfully. Jul 07 18:22:11 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 1073741824" returned: 0 in 0.870s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:11 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 Jul 07 18:22:11 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:12 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021" returned: 0 in 0.646s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f0cae23-5e8e-4156-8686-b37aea001b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3eb2ee5-adae-4e36-acbe-cb443d08a5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:12 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Volume volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 (8bdaa5ef-432f-4ada-bd80-71fdeafe1021): created successfully Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3eb2ee5-adae-4e36-acbe-cb443d08a5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Flow 'volume_create_manager' (531794dd-c609-426d-affc-202179190253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:12 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-810aed1a-fba7-42ed-95cd-3fda1792e26a tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created volume successfully. Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:12 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:22:12 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-8bdaa5ef-432f-4ada-bd80-71fdeafe1021-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-8bdaa5ef-432f-4ada-bd80-71fdeafe1021-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-quobyte-8bdaa5ef-432f-4ada-bd80-71fdeafe1021" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-8bdaa5ef-432f-4ada-bd80-71fdeafe1021" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d359b15c-31d8-489c-a089-e1e1cf119de9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:13 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 Jul 07 18:22:13 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:13 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.654s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:22:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:22:14 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021" returned: 0 in 0.767s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:14 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021 Jul 07 18:22:14 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:14 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-8bdaa5ef-432f-4ada-bd80-71fdeafe1021" returned: 0 in 0.624s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-8bdaa5ef-432f-4ada-bd80-71fdeafe1021" released by "delete_volume" :: held 1.431s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created reservations ['24b3c635-c71e-481c-9ae9-943d9610bbfe', 'b90fdad5-e1fa-4285-ac52-ec74de4969e0', 'c8da9b66-c977-4dfa-beb7-a21a4fac9d2b', '085b40a2-5b90-421f-a53e-dccf7225f68a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:14 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:22:14 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-1a66a584-63f6-40ef-9a8d-06f6f80c44c7-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:15 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.622s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:15 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:22:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Deleted volume successfully. Jul 07 18:22:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-1a66a584-63f6-40ef-9a8d-06f6f80c44c7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eff02411-7fed-442a-af72-65b9ebcbe5ba tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-8bdaa5ef-432f-4ada-bd80-71fdeafe1021-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-quobyte-1a66a584-63f6-40ef-9a8d-06f6f80c44c7" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-1a66a584-63f6-40ef-9a8d-06f6f80c44c7" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:15 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1ffd94-c423-44a4-81e7-e17b86566f40]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:15 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 Jul 07 18:22:15 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:16 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7" returned: 0 in 0.743s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:16 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7 Jul 07 18:22:16 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:16 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1a66a584-63f6-40ef-9a8d-06f6f80c44c7" returned: 0 in 0.613s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-1a66a584-63f6-40ef-9a8d-06f6f80c44c7" released by "delete_volume" :: held 1.395s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:16 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created reservations ['beb852c0-0dd1-401e-9e72-f6e1927cf128', '2861ec4a-3a35-45b9-a060-cddae9f854ce', '94d30b9b-dd66-406f-ab76-f6ef628801d8', '3fd670a7-abaa-4e53-974e-655b2aef7088'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:17 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:22:17 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:17 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.644s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:22:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Deleted volume successfully. Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6f3219fa-8c06-44f9-95a8-5035418a02be tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-1a66a584-63f6-40ef-9a8d-06f6f80c44c7-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-quobyte-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1076ae2-6155-446c-bbbc-b1e0a040e422]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:17 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 Jul 07 18:22:17 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:18 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581" returned: 0 in 0.783s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:18 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581 Jul 07 18:22:18 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:19 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581" returned: 0 in 0.628s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581" released by "delete_volume" :: held 1.448s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created reservations ['d6f33fe2-a48a-485c-a835-8484052b60b7', '2e9b2550-8bd9-44bc-8c91-3ce063cf7b69', 'd682d311-e4eb-4211-bef0-a350df1a9973', '76c46380-9416-4ae7-95bb-3f41cd6201ca'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:19 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:22:19 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-393dc30b-de45-4c12-9d01-2405a59f8d1a-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-393dc30b-de45-4c12-9d01-2405a59f8d1a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-quobyte-393dc30b-de45-4c12-9d01-2405a59f8d1a" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-393dc30b-de45-4c12-9d01-2405a59f8d1a" acquired by "delete_volume" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:19 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.664s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:19 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:22:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Deleted volume successfully. Jul 07 18:22:20 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[4484a458-8a80-4393-b0c8-ed2ba618d8e4]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-907b26dc-a273-4fa9-98cc-cf55c6ba52aa tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-fdc0cd6d-7838-44ff-8d2d-fb0ee6cc2581-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:20 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a Jul 07 18:22:20 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:20 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a" returned: 0 in 0.763s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:20 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a Jul 07 18:22:20 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:21 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-393dc30b-de45-4c12-9d01-2405a59f8d1a" returned: 0 in 0.636s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-393dc30b-de45-4c12-9d01-2405a59f8d1a" released by "delete_volume" :: held 1.456s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:21 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created reservations ['d64e0c5d-29f2-4838-ba67-f693ebade267', '12be1558-0de1-4af6-9985-36235ea521db', 'e73cbed9-c2a1-4644-8cb6-c75f4526dfc8', '432a08c2-f141-4dbf-a2de-61d3a82e35d5'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:22:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:21 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:22:21 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-b1365894-5df9-4e06-b1ff-20c99f092fc1-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-b1365894-5df9-4e06-b1ff-20c99f092fc1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:22 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.647s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-quobyte-b1365894-5df9-4e06-b1ff-20c99f092fc1" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:22 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Deleted volume successfully. Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-b1365894-5df9-4e06-b1ff-20c99f092fc1" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e9f46be9-7dd9-4ac5-a288-dbee6c9b3e30 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-393dc30b-de45-4c12-9d01-2405a59f8d1a-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[683fed46-db39-4ef5-a7c4-3fdd7646e11e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:22 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 Jul 07 18:22:22 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:22 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1" returned: 0 in 0.724s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:22 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1 Jul 07 18:22:22 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:23 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b1365894-5df9-4e06-b1ff-20c99f092fc1" returned: 0 in 0.658s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-b1365894-5df9-4e06-b1ff-20c99f092fc1" released by "delete_volume" :: held 1.424s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:23 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created reservations ['9c9d21bd-6ab5-4991-abc8-2396bb4494ef', '0ecce2a9-34c2-4c4f-8c56-9318929a0807', 'de561cfe-7e57-440b-9e26-02aaeaf03aa9', '86078101-abb9-4772-b07a-ddd6103b3b4e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:22:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:23 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:22:23 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-a0dd95a9-1d18-4d9a-98bf-4a2c28967d02-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-a0dd95a9-1d18-4d9a-98bf-4a2c28967d02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-quobyte-fd6071e1-6b92-43d0-b244-c8add9c24b8e" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-fd6071e1-6b92-43d0-b244-c8add9c24b8e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-quobyte-a0dd95a9-1d18-4d9a-98bf-4a2c28967d02" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:24 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-a0dd95a9-1d18-4d9a-98bf-4a2c28967d02" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Deleting offline snapshot a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 of volume fd6071e1-6b92-43d0-b244-c8add9c24b8e {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] snapshot_file for this snap is: volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.667s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:22:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Deleted volume successfully. Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c172af26-0287-46c4-a377-732e5681ae95]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-88266b40-ec9c-4999-9201-f74ee676de51 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-b1365894-5df9-4e06-b1ff-20c99f092fc1-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:24 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 Jul 07 18:22:24 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:25 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02" returned: 0 in 0.763s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:22:25 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[305ebe54-d0fd-48da-bd91-4f1aed367f2b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:25 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e Jul 07 18:22:25 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:26 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e" returned: 0 in 0.773s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:26 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 Jul 07 18:22:26 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:26 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02" returned: 0 in 0.777s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:26 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02 Jul 07 18:22:26 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:27 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e.a0dd95a9-1d18-4d9a-98bf-4a2c28967d02" returned: 0 in 0.665s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-a0dd95a9-1d18-4d9a-98bf-4a2c28967d02" released by "_delete_snapshot" :: held 3.097s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-fd6071e1-6b92-43d0-b244-c8add9c24b8e" released by "delete_snapshot" :: held 3.119s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:27 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created reservations ['acbc0036-7f20-439d-9d7a-26a135a3fb84', '48de743f-f3b5-45b5-9d32-e30a38bc3fec', 'f459da4d-a8e3-4de4-8eb6-f61906e27c93', '9acf533d-7ac3-4c91-915d-cc964c14e253'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:22:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Delete snapshot completed successfully. Jul 07 18:22:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-365e2e5b-f0ba-4678-ba97-bc73aa2bd4ea tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-a0dd95a9-1d18-4d9a-98bf-4a2c28967d02-delete_snapshot" released by "delete_snapshot" :: held 3.248s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-fd6071e1-6b92-43d0-b244-c8add9c24b8e-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-fd6071e1-6b92-43d0-b244-c8add9c24b8e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "cinder-quobyte-fd6071e1-6b92-43d0-b244-c8add9c24b8e" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:22:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-fd6071e1-6b92-43d0-b244-c8add9c24b8e" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:22:28 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7708f04-30b2-423e-baee-25ec5ed295e0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:28 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e Jul 07 18:22:28 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:29 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e" returned: 0 in 0.747s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:29 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e Jul 07 18:22:29 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:30 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fd6071e1-6b92-43d0-b244-c8add9c24b8e" returned: 0 in 0.667s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-quobyte-fd6071e1-6b92-43d0-b244-c8add9c24b8e" released by "delete_volume" :: held 1.468s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Created reservations ['d238a71c-44b9-4a32-bf8c-06bbffe108e3', 'c47610ea-aca3-46f9-a9ae-b7cb53361ac9', 'f170276b-faca-4977-ac33-5ccb9a7aeec4', 'b2221ea9-ec11-41b9-bfe9-dc27f7b910d7'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:30 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:22:30 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:30 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.651s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:22:30 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Deleted volume successfully. Jul 07 18:22:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-72668304-1e51-4fec-99dc-5eb21cf00115 tempest-CreateVolumesFromSnapshotTest-1523249344 None] Lock "cinder-fd6071e1-6b92-43d0-b244-c8add9c24b8e-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:22:40 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=47,cinder:UPDATE=74,cinder:DELETE=7,cinder:INSERT=15 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:22:40 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=59,cinder:UPDATE=81,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (bd1eb643-a9aa-43ca-96d8-0eb3df143a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cf2acf-70ae-4b17-8da2-3b3f69edb8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02cf2acf-70ae-4b17-8da2-3b3f69edb8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1966683106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2914d32d-c53e-4121-82f4-adcc17949b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:51Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f63a3a-5e13-41d1-821d-88d364345312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f63a3a-5e13-41d1-821d-88d364345312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5085e7a-abe0-4329-b70f-0202100b3279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5085e7a-abe0-4329-b70f-0202100b3279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2914d32d-c53e-4121-82f4-adcc17949b1d', 'volume_name': 'volume-2914d32d-c53e-4121-82f4-adcc17949b1d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65abc7f7-2231-4e9c-8922-ac3260dc9416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65abc7f7-2231-4e9c-8922-ac3260dc9416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d658d094-d25e-451c-8375-bdad97256f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:50 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Volume 2914d32d-c53e-4121-82f4-adcc17949b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2914d32d-c53e-4121-82f4-adcc17949b1d', 'volume_size': 1} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1966683106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2914d32d-c53e-4121-82f4-adcc17949b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:51Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Creating volume 2914d32d-c53e-4121-82f4-adcc17949b1d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:51 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:51 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d 1073741824 Jul 07 18:22:51 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (cac734d1-d4ce-40ec-a277-51def00941a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfe8cde-4b8b-4154-8f2e-e53041c7b66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfe8cde-4b8b-4154-8f2e-e53041c7b66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1134825887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff066dd-274f-4dfd-b9c1-6c9693e739f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:51Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eedee5b-6cad-4479-a495-1561aba419f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eedee5b-6cad-4479-a495-1561aba419f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d035204-bff9-4c00-993d-5988223d947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d035204-bff9-4c00-993d-5988223d947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ff066dd-274f-4dfd-b9c1-6c9693e739f7', 'volume_name': 'volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e032ead-f7d2-46c7-8828-14878d9cfe08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e032ead-f7d2-46c7-8828-14878d9cfe08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4337db-52b9-4675-97fc-a5c46a2cf4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:51 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Volume 4ff066dd-274f-4dfd-b9c1-6c9693e739f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7', 'volume_size': 1} Jul 07 18:22:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:52 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d 1073741824" returned: 0 in 1.228s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:52 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d Jul 07 18:22:52 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (5dded985-956e-4fbc-a7a7-3b3e0d3389eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f31ee00-aaed-4d7a-9e40-28c8da443cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f31ee00-aaed-4d7a-9e40-28c8da443cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167245179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c94fc3-ac52-4421-bbff-12ab916a1f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:53Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cbac56-c130-445c-a45a-6bd09bb6583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cbac56-c130-445c-a45a-6bd09bb6583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f975e6a9-5e76-4c20-aa7f-b6878f398098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f975e6a9-5e76-4c20-aa7f-b6878f398098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c94fc3-ac52-4421-bbff-12ab916a1f55', 'volume_name': 'volume-34c94fc3-ac52-4421-bbff-12ab916a1f55', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cc5653-815a-4717-ab9e-66c50df3adcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8cc5653-815a-4717-ab9e-66c50df3adcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabc0e7b-fb0f-40ac-a5af-fb23354621f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume 34c94fc3-ac52-4421-bbff-12ab916a1f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c94fc3-ac52-4421-bbff-12ab916a1f55', 'volume_size': 1} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (b7f200d7-0d84-474e-a16e-49ffc7256119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1ddc12-8d52-468b-af8b-377cae56c4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1ddc12-8d52-468b-af8b-377cae56c4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-179887563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e837c7-ee30-4808-9bfa-948ec0595e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:53Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de29d160-9d94-4f1c-82eb-8f04aa73fd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de29d160-9d94-4f1c-82eb-8f04aa73fd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5254b3c2-6a3d-478d-b37f-8aa2d34453ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5254b3c2-6a3d-478d-b37f-8aa2d34453ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e837c7-ee30-4808-9bfa-948ec0595e44', 'volume_name': 'volume-e7e837c7-ee30-4808-9bfa-948ec0595e44', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3266cbe6-2d8f-417a-97ba-dbb99c3c6fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3266cbe6-2d8f-417a-97ba-dbb99c3c6fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:52 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528d1f1b-b890-4ebd-9f1a-4807a75c9c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:52 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Volume e7e837c7-ee30-4808-9bfa-948ec0595e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e837c7-ee30-4808-9bfa-948ec0595e44', 'volume_size': 1} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (5b05252c-3a8f-44eb-9a7a-9f7dce59a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1697683b-93f5-4951-84e5-d84dec9b7e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1697683b-93f5-4951-84e5-d84dec9b7e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-102421985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0ecbd3-6925-41e8-9d0d-68dbd540af0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:53Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b650894d-4ff2-48b0-a58a-e0da1f28f37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b650894d-4ff2-48b0-a58a-e0da1f28f37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502a4498-33e0-4956-8623-d03c9d28d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502a4498-33e0-4956-8623-d03c9d28d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f0ecbd3-6925-41e8-9d0d-68dbd540af0f', 'volume_name': 'volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd88bb1-6a14-4c20-809e-e41162c4b26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd88bb1-6a14-4c20-809e-e41162c4b26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dac5ccc-28e0-49e6-9fa1-462be3975ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Volume 4f0ecbd3-6925-41e8-9d0d-68dbd540af0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f', 'volume_size': 1} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:53 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d" returned: 0 in 1.163s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] <== create_volume: return (2481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.484s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.004s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1134825887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff066dd-274f-4dfd-b9c1-6c9693e739f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:51Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Creating volume 4ff066dd-274f-4dfd-b9c1-6c9693e739f7 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:53 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d658d094-d25e-451c-8375-bdad97256f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2914d32d-c53e-4121-82f4-adcc17949b1d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 1073741824 Jul 07 18:22:53 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb47460f-35d7-4c47-ba0b-72168bc1099b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (0414c87e-7a89-4024-ab86-8ee8677357e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70241115-a86f-4c13-8307-7d421c2261d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Volume volume-2914d32d-c53e-4121-82f4-adcc17949b1d (2914d32d-c53e-4121-82f4-adcc17949b1d): created successfully Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb47460f-35d7-4c47-ba0b-72168bc1099b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (bd1eb643-a9aa-43ca-96d8-0eb3df143a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70241115-a86f-4c13-8307-7d421c2261d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1864700844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e97dcf4-ff9e-4243-84c4-c9891999fee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:53Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae04850-8e06-461f-a0ee-c7fae44d8da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae04850-8e06-461f-a0ee-c7fae44d8da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa9eccd-1b16-4c82-8e4d-695e85c56594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa9eccd-1b16-4c82-8e4d-695e85c56594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e97dcf4-ff9e-4243-84c4-c9891999fee1', 'volume_name': 'volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c222cafa-03b2-4c75-9be4-6b5513e514b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c222cafa-03b2-4c75-9be4-6b5513e514b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e02a1ac-022a-49ea-86e5-7eef6be9f4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Volume 7e97dcf4-ff9e-4243-84c4-c9891999fee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1', 'volume_size': 1} Jul 07 18:22:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c0a0a21d-4008-46a3-a31a-c11d36373a64 tempest-CreateVolumesFromImageTest-451826983 None] Created volume successfully. Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Flow 'volume_create_manager' (5c306ceb-c9bd-45c5-8889-f129c5b36f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73691118-8c5d-4213-82d1-d190242cc32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73691118-8c5d-4213-82d1-d190242cc32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14425fe6-d4d1-44d4-a5d4-bbe3fdce6719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562575e614de4e95ae49efbbf5132e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:54Z,use_quota=True,user_id='057b3d3c289a4943817f34d81b69a075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e4cad3-5693-4792-a85c-9f0d84f7ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e4cad3-5693-4792-a85c-9f0d84f7ae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14319b7a-e6da-44d0-a205-7f2a152fe878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.image.glance [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Creating Keystone auth plugin from conf {{(pid=86972) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14319b7a-e6da-44d0-a205-7f2a152fe878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14425fe6-d4d1-44d4-a5d4-bbe3fdce6719', 'volume_name': 'volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719', 'volume_size': 1, 'image_id': 'ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfb4e14026c7304ccf57b7418e865728', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '562575e614de4e95ae49efbbf5132e9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49e8c34c3caf3982032e2e3d0d5602c1067a8a416f552268f8b47086cdaa48b376ac649654390ac60d5a81d3900760a842d6ab9e8ad7c9b1ee49a6634cedc84d', 'id': 'ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'created_at': datetime.datetime(2026, 7, 7, 16, 22, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 22, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5/file', 'properties': {}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119b981c-6bf9-45b7-884a-82dde372dfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119b981c-6bf9-45b7-884a-82dde372dfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da646f89-640a-4e59-8e0e-7c32beb17e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:54 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Volume 14425fe6-d4d1-44d4-a5d4-bbe3fdce6719: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719', 'volume_size': 1, 'image_id': 'ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfb4e14026c7304ccf57b7418e865728', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '562575e614de4e95ae49efbbf5132e9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49e8c34c3caf3982032e2e3d0d5602c1067a8a416f552268f8b47086cdaa48b376ac649654390ac60d5a81d3900760a842d6ab9e8ad7c9b1ee49a6634cedc84d', 'id': 'ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'created_at': datetime.datetime(2026, 7, 7, 16, 22, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 22, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5/file', 'properties': {}}, 'image_service': } Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Trying to clone 14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 from image ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'metadata': {}}]). {{(pid=86972) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 18:22:54 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 1073741824" returned: 0 in 1.066s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:54 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 Jul 07 18:22:54 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:22:54 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Image download 0.00 MB at 0.00 MB/s Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[872d1e98-b1b0-49b8-9ba5-f268e8a23895]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:54 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD Jul 07 18:22:54 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:55 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7" returned: 0 in 0.706s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.596s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167245179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c94fc3-ac52-4421-bbff-12ab916a1f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:53Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Creating volume 34c94fc3-ac52-4421-bbff-12ab916a1f55 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:55 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4337db-52b9-4675-97fc-a5c46a2cf4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:55 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 1073741824 Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f1f2d2-8907-48c3-84b7-3b300b5d13c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:55 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:55 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Volume volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 (4ff066dd-274f-4dfd-b9c1-6c9693e739f7): created successfully Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f1f2d2-8907-48c3-84b7-3b300b5d13c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (cac734d1-d4ce-40ec-a277-51def00941a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:55 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-28a273c0-e21c-47ae-a04c-3957470e78f4 tempest-CreateVolumesFromImageTest-451826983 None] Created volume successfully. Jul 07 18:22:55 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Flow 'volume_create_manager' (7bfcbaf6-b83f-4355-b582-729bc04194eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d743afe4-1eea-41cd-bcaf-0f6e1ed39a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d743afe4-1eea-41cd-bcaf-0f6e1ed39a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04010179-3ec2-4903-9848-0d343abec2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf9ee4fc8bd48da80f54665b41bcf80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:55Z,use_quota=True,user_id='0e2a320db8e040f0a75c6c5e8b1d5685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb6fb96b-195d-4741-bdff-6af6f3f4a5dc),volume_type_id=bb6fb96b-195d-4741-bdff-6af6f3f4a5dc)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfffd1b7-8d12-4f77-98a9-3e9646330294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfffd1b7-8d12-4f77-98a9-3e9646330294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:55 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD Jul 07 18:22:55 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7c7425-6531-4488-8d05-216e47480188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.image.glance [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Creating Keystone auth plugin from conf {{(pid=86972) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df7c7425-6531-4488-8d05-216e47480188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04010179-3ec2-4903-9848-0d343abec2d4', 'volume_name': 'volume-04010179-3ec2-4903-9848-0d343abec2d4', 'volume_size': 1, 'image_id': '79cd9fcf-d922-47ec-bec2-8af2f3067697', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79cd9fcf-d922-47ec-bec2-8af2f3067697', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc9f57cc787ce82c671919bfbc7e57a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6cf9ee4fc8bd48da80f54665b41bcf80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0e1f171540fa628c2ccc2e7c267df66305b25b951257b62b0306d49c6aea5cef6683306def917698a3452dbb2109e6d71aa1762fdf2b96c6a7e50182f2c20e1', 'id': '79cd9fcf-d922-47ec-bec2-8af2f3067697', 'created_at': datetime.datetime(2026, 7, 7, 16, 22, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 22, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79cd9fcf-d922-47ec-bec2-8af2f3067697/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f79804-ad04-4843-9a0d-eb4bf5e9821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f79804-ad04-4843-9a0d-eb4bf5e9821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827408dc-5cbb-488f-8cac-e846871f9570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:55 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Volume 04010179-3ec2-4903-9848-0d343abec2d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04010179-3ec2-4903-9848-0d343abec2d4', 'volume_size': 1, 'image_id': '79cd9fcf-d922-47ec-bec2-8af2f3067697', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79cd9fcf-d922-47ec-bec2-8af2f3067697', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc9f57cc787ce82c671919bfbc7e57a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6cf9ee4fc8bd48da80f54665b41bcf80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0e1f171540fa628c2ccc2e7c267df66305b25b951257b62b0306d49c6aea5cef6683306def917698a3452dbb2109e6d71aa1762fdf2b96c6a7e50182f2c20e1', 'id': '79cd9fcf-d922-47ec-bec2-8af2f3067697', 'created_at': datetime.datetime(2026, 7, 7, 16, 22, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 22, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79cd9fcf-d922-47ec-bec2-8af2f3067697/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 18:22:55 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Trying to clone 04010179-3ec2-4903-9848-0d343abec2d4 from image 79cd9fcf-d922-47ec-bec2-8af2f3067697 at location (None, [{'url': 'file:///opt/stack/data/glance/images/79cd9fcf-d922-47ec-bec2-8af2f3067697', 'metadata': {}}]). {{(pid=86972) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 18:22:56 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Image download 0.00 MB at 0.00 MB/s Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4f9453-e042-49bb-9d83-c151cfe44dd6]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:56 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD Jul 07 18:22:56 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:56 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:56 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD" returned: 1 in 0.807s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Temporary image ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5 is fetched for user 057b3d3c289a4943817f34d81b69a075. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 1073741824" returned: 0 in 1.006s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:56 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 Jul 07 18:22:56 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f143401-7583-4f27-b950-d76daf7fdfde]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:56 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD Jul 07 18:22:56 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:56 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD" returned: 0 in 0.780s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:56 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD Jul 07 18:22:56 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:57 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55" returned: 0 in 0.665s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.065s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-179887563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e837c7-ee30-4808-9bfa-948ec0595e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:53Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Creating volume e7e837c7-ee30-4808-9bfa-948ec0595e44 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:57 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabc0e7b-fb0f-40ac-a5af-fb23354621f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c94fc3-ac52-4421-bbff-12ab916a1f55', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:57 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 1073741824 Jul 07 18:22:57 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff21e5c4-b96b-4213-b5b5-228915faf0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 (34c94fc3-ac52-4421-bbff-12ab916a1f55): created successfully Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff21e5c4-b96b-4213-b5b5-228915faf0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (5dded985-956e-4fbc-a7a7-3b3e0d3389eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1d80edc4-a740-4a8e-a401-2bd265c716fe tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created volume successfully. Jul 07 18:22:57 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:57 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD Jul 07 18:22:57 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:57 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD" returned: 1 in 0.799s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Temporary image 79cd9fcf-d922-47ec-bec2-8af2f3067697 is fetched for user 0e2a320db8e040f0a75c6c5e8b1d5685. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8261a0f5-9cd5-4f52-a722-526ed702b84e]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:57 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD Jul 07 18:22:57 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:58 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 1073741824" returned: 0 in 0.972s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:58 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD" returned: 1 in 0.875s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:58 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 Jul 07 18:22:58 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:58 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD" returned: 0 in 0.810s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:58 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD Jul 07 18:22:58 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:58 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44" returned: 0 in 0.670s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.576s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-102421985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0ecbd3-6925-41e8-9d0d-68dbd540af0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:53Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Creating volume 4f0ecbd3-6925-41e8-9d0d-68dbd540af0f {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:22:58 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:58 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f 1073741824 Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528d1f1b-b890-4ebd-9f1a-4807a75c9c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e837c7-ee30-4808-9bfa-948ec0595e44', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:58 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e132d1c-7ece-49d9-b1f8-c0e189ada1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:22:58 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Volume volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 (e7e837c7-ee30-4808-9bfa-948ec0595e44): created successfully Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e132d1c-7ece-49d9-b1f8-c0e189ada1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:22:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (b7f200d7-0d84-474e-a16e-49ffc7256119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:22:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-52b18a3a-c08c-45a5-9a6a-4428630a8fe9 tempest-CreateVolumesFromImageTest-451826983 None] Created volume successfully. Jul 07 18:22:59 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD" returned: 1 in 0.797s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:22:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:22:59 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Jul 07 18:22:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f 1073741824" returned: 0 in 0.839s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:22:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:22:59 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f Jul 07 18:22:59 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:00 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f" returned: 0 in 0.669s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.643s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1864700844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e97dcf4-ff9e-4243-84c4-c9891999fee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40708f03a5a04dc1a035cf0f7d43b3dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:53Z,use_quota=True,user_id='6a250b7dab774babb8877d328f22e279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Creating volume 7e97dcf4-ff9e-4243-84c4-c9891999fee1 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:00 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dac5ccc-28e0-49e6-9fa1-462be3975ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:00 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 1073741824 Jul 07 18:23:00 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd2bacc-2a7c-4beb-af4e-dcacef0bbe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:00 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Volume volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f (4f0ecbd3-6925-41e8-9d0d-68dbd540af0f): created successfully Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd2bacc-2a7c-4beb-af4e-dcacef0bbe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (5b05252c-3a8f-44eb-9a7a-9f7dce59a336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:00 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-120b6e4f-1f9f-4945-8ba6-a926a66be92b tempest-CreateVolumesFromImageTest-451826983 None] Created volume successfully. Jul 07 18:23:01 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 1073741824" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:01 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 Jul 07 18:23:01 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:01 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1" returned: 0 in 0.644s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.991s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e02a1ac-022a-49ea-86e5-7eef6be9f4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3d98c2-71f3-4569-a302-8bfeee23ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Creating offline snapshot 58d7b262-39a2-4bd2-9af8-d9663eb258ff of volume 34c94fc3-ac52-4421-bbff-12ab916a1f55 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:23:01 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Volume volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 (7e97dcf4-ff9e-4243-84c4-c9891999fee1): created successfully Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3d98c2-71f3-4569-a302-8bfeee23ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Flow 'volume_create_manager' (0414c87e-7a89-4024-ab86-8ee8677357e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42e5cb3-1202-41ca-b0b3-c34c157b1c74]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:01 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-190208cb-85cb-4946-b97b-b0de828cd74a tempest-CreateVolumesFromImageTest-451826983 None] Created volume successfully. Jul 07 18:23:02 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 Jul 07 18:23:02 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-7e97dcf4-ff9e-4243-84c4-c9891999fee1-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-7e97dcf4-ff9e-4243-84c4-c9891999fee1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-quobyte-7e97dcf4-ff9e-4243-84c4-c9891999fee1" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-7e97dcf4-ff9e-4243-84c4-c9891999fee1" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:02 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd63f8b-c5f4-450c-90e5-634e3495e421]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:02 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 Jul 07 18:23:02 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:02 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55" returned: 0 in 0.836s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:02 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff 1G Jul 07 18:23:02 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:03 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1" returned: 0 in 0.771s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:03 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1 Jul 07 18:23:03 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:03 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff 1G" returned: 0 in 0.929s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:03 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff Jul 07 18:23:03 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:03 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7e97dcf4-ff9e-4243-84c4-c9891999fee1" returned: 0 in 0.714s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-7e97dcf4-ff9e-4243-84c4-c9891999fee1" released by "delete_volume" :: held 1.535s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:03 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Created reservations ['3f9f93ec-19c8-486a-bd71-c45a1d41855b', '5d975f64-1f91-42cd-a8df-496b9563d02c', '4643863e-cdda-4c35-9270-c7bba10cff91', '1d82fc06-406c-42e0-a4fe-4f9d4d60f81d'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:04 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:04 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:04 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff" returned: 0 in 0.725s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:04 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff is being set with open permissions: ugo+rw Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:04 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff Jul 07 18:23:04 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-quobyte-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0d9ae1-0b16-43e4-bf79-cbad7b027058]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:04 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.731s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Deleted volume successfully. Jul 07 18:23:04 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f Jul 07 18:23:04 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a2b571fb-5b6b-4acb-97e6-f99e3b6a4eed tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-7e97dcf4-ff9e-4243-84c4-c9891999fee1-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:05 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff" returned: 0 in 0.729s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:05 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.info Jul 07 18:23:05 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:05 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f" returned: 0 in 0.767s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:05 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f Jul 07 18:23:05 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:05 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.info" returned: 0 in 0.703s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:05 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.info is being set with open permissions: ugo+rw Jul 07 18:23:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:05 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.info Jul 07 18:23:05 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:06 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f" released by "delete_volume" :: held 1.503s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Created reservations ['ce3e37ad-e851-4dba-a826-f06f732afc5d', '1bf480dc-e9c8-44f5-aa88-5a51cd0926a3', 'b5978008-c825-4db2-80c1-960a5a445102', 'bae2ae6e-0251-4aa0-b533-598f8bcb9128'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:06 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:06 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:06 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.info" returned: 0 in 0.666s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.703s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.488s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14425fe6-d4d1-44d4-a5d4-bbe3fdce6719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562575e614de4e95ae49efbbf5132e9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:54Z,use_quota=True,user_id='057b3d3c289a4943817f34d81b69a075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Creating volume 14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:06 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:06 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 1073741824 Jul 07 18:23:06 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b6b5bd1c-087b-4966-98ab-c4e7e9609f73 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Create snapshot completed successfully Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-e7e837c7-ee30-4808-9bfa-948ec0595e44-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-e7e837c7-ee30-4808-9bfa-948ec0595e44-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-quobyte-e7e837c7-ee30-4808-9bfa-948ec0595e44" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-e7e837c7-ee30-4808-9bfa-948ec0595e44" acquired by "delete_volume" :: waited 0.030s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7eb4e6-b1fd-4b2c-9565-8f7a97910a80]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:07 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.724s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Deleted volume successfully. Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c74de441-a622-45af-94cd-77f934280557 tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-4f0ecbd3-6925-41e8-9d0d-68dbd540af0f-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:07 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 Jul 07 18:23:07 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:07 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 1073741824" returned: 0 in 1.055s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:07 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 Jul 07 18:23:07 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (2d4b482c-c9f0-4971-8121-ba7ba2e0f693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02625179-4796-4c5d-b7b9-333f9c74c475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02625179-4796-4c5d-b7b9-333f9c74c475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1442584855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a618616b-cc62-42c6-8436-3617e47e95be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:08Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269b174e-83d2-4c56-8a12-403447c7037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269b174e-83d2-4c56-8a12-403447c7037b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f271699-0289-4040-a808-bd6261ae8013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f271699-0289-4040-a808-bd6261ae8013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a618616b-cc62-42c6-8436-3617e47e95be', 'volume_name': 'volume-a618616b-cc62-42c6-8436-3617e47e95be', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b34b6b-7006-425b-b34f-4b446a1065bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b34b6b-7006-425b-b34f-4b446a1065bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d711d7f9-370a-4500-a007-61617e7eb6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:07 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume a618616b-cc62-42c6-8436-3617e47e95be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a618616b-cc62-42c6-8436-3617e47e95be', 'volume_size': 1} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:07 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44" returned: 0 in 0.986s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:08 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44 Jul 07 18:23:08 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (0214d423-cbc0-4ec4-a218-398b2bb7ee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab805340-fa08-4e9d-a112-ab58b70de261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab805340-fa08-4e9d-a112-ab58b70de261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861851639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d409001a-851e-4b15-9b80-5cee245308ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:09Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fd1c09-d9ff-4635-aa9b-4ded15da7c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fd1c09-d9ff-4635-aa9b-4ded15da7c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23738b2f-1832-44be-80dd-5ea1eececd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23738b2f-1832-44be-80dd-5ea1eececd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd409001a-851e-4b15-9b80-5cee245308ac', 'volume_name': 'volume-d409001a-851e-4b15-9b80-5cee245308ac', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52571488-e502-45fe-98d0-fa531a571932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52571488-e502-45fe-98d0-fa531a571932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:08 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9169374b-0929-4581-b5be-b910fb614298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:08 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume d409001a-851e-4b15-9b80-5cee245308ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d409001a-851e-4b15-9b80-5cee245308ac', 'volume_size': 1} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" returned: 0 in 1.057s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.364s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04010179-3ec2-4903-9848-0d343abec2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cf9ee4fc8bd48da80f54665b41bcf80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:22:55Z,use_quota=True,user_id='0e2a320db8e040f0a75c6c5e8b1d5685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb6fb96b-195d-4741-bdff-6af6f3f4a5dc),volume_type_id=bb6fb96b-195d-4741-bdff-6af6f3f4a5dc)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Creating volume 04010179-3ec2-4903-9848-0d343abec2d4 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:08 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Attempting download of ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'metadata': {}}])) to volume 14425fe6-d4d1-44d4-a5d4-bbe3fdce6719. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:23:08 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 1073741824 Jul 07 18:23:08 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (fa06f307-070e-4e8a-8f52-953e0ec05f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a242c16-c43f-4448-a964-cfffca417d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6f8eef-ae28-4b88-9b88-610114fdfdf3]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_qjy3g8sy {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:08 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e7e837c7-ee30-4808-9bfa-948ec0595e44" returned: 0 in 0.948s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a242c16-c43f-4448-a964-cfffca417d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753969862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2710303e-c09a-4ebd-ac54-903e571924f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:09Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86fb703-1c30-424a-be4e-ed19d96ab2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c86fb703-1c30-424a-be4e-ed19d96ab2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504afbfd-eb48-4548-b08e-ab3149701ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:08 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504afbfd-eb48-4548-b08e-ab3149701ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2710303e-c09a-4ebd-ac54-903e571924f5', 'volume_name': 'volume-2710303e-c09a-4ebd-ac54-903e571924f5', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d11a391-45d1-4dbe-beab-4318d4025520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d11a391-45d1-4dbe-beab-4318d4025520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07207013-c499-44db-9d26-f89c716b4f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:09 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume 2710303e-c09a-4ebd-ac54-903e571924f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2710303e-c09a-4ebd-ac54-903e571924f5', 'volume_size': 1} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-e7e837c7-ee30-4808-9bfa-948ec0595e44" released by "delete_volume" :: held 2.088s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:09 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_qjy3g8sy Jul 07 18:23:09 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Created reservations ['331ee23e-4d46-4000-9037-d5d8692dac99', '23fd2d65-2e6c-4126-b70c-7c7d0b6ffed6', 'c4ad9c56-13b0-4a94-82d0-fc0f7c53e844', 'ce7e3f0e-8816-4724-a85c-6420ac3af52f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:09 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:09 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (4b5797e0-e44a-40b9-b550-e076412db43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3035eb9-6f4f-4cf9-904b-0507c58d1557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3035eb9-6f4f-4cf9-904b-0507c58d1557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039164304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b34b64e-9899-4c8a-b074-7e6acf5d7b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:09Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6957c0b-2d79-4eef-8e0f-ae665a0b9cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6957c0b-2d79-4eef-8e0f-ae665a0b9cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118935e8-301a-411a-ba77-81d32a00dbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (118935e8-301a-411a-ba77-81d32a00dbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b34b64e-9899-4c8a-b074-7e6acf5d7b6d', 'volume_name': 'volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc93a2c-79e4-4ee0-bd7a-e20c1a5e6d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc93a2c-79e4-4ee0-bd7a-e20c1a5e6d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2def86-5b92-4822-9da2-5c31b801de6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:09 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume 6b34b64e-9899-4c8a-b074-7e6acf5d7b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d', 'volume_size': 1} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (957ae910-3dc9-4bd4-a4a5-cede8c438807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6915a5ce-6e23-4f78-8dee-b316087e79a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:10 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6915a5ce-6e23-4f78-8dee-b316087e79a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1929839672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e668b614-04df-4d8e-9122-6cb5da35006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:10Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7293f916-98c3-4a78-9eec-123782060646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7293f916-98c3-4a78-9eec-123782060646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9274f0f8-b978-4fcf-ae45-9f4f3fe2ef73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9274f0f8-b978-4fcf-ae45-9f4f3fe2ef73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e668b614-04df-4d8e-9122-6cb5da35006b', 'volume_name': 'volume-e668b614-04df-4d8e-9122-6cb5da35006b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed466fc-91c1-437d-816c-ac17ee9db55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed466fc-91c1-437d-816c-ac17ee9db55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48eb7ad4-60b3-4d3f-95ad-6422899a5448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:10 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume e668b614-04df-4d8e-9122-6cb5da35006b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e668b614-04df-4d8e-9122-6cb5da35006b', 'volume_size': 1} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_qjy3g8sy" returned: 0 in 1.157s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_qjy3g8sy {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:10 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 1073741824" returned: 0 in 1.342s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:10 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 Jul 07 18:23:10 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:10 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_qjy3g8sy Jul 07 18:23:10 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:10 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-4ff066dd-274f-4dfd-b9c1-6c9693e739f7-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.926s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Deleted volume successfully. Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-4ff066dd-274f-4dfd-b9c1-6c9693e739f7-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2ccec73a-d2dd-4980-bb75-8793e090ecfb tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-e7e837c7-ee30-4808-9bfa-948ec0595e44-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-quobyte-4ff066dd-274f-4dfd-b9c1-6c9693e739f7" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-4ff066dd-274f-4dfd-b9c1-6c9693e739f7" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef9450a-4609-4105-9b42-2f11af3108a6]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:10 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 Jul 07 18:23:10 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:10 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4" returned: 0 in 0.790s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.981s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1442584855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a618616b-cc62-42c6-8436-3617e47e95be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:08Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Creating volume a618616b-cc62-42c6-8436-3617e47e95be {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:10 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:10 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be 1073741824 Jul 07 18:23:10 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:10 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_qjy3g8sy" returned: 1 in 0.918s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_qjy3g8sy' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73583d4-a8ce-4c4e-b961-a97442fb0703]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Attempting download of 79cd9fcf-d922-47ec-bec2-8af2f3067697 ((None, [{'url': 'file:///opt/stack/data/glance/images/79cd9fcf-d922-47ec-bec2-8af2f3067697', 'metadata': {}}])) to volume 04010179-3ec2-4903-9848-0d343abec2d4. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 18:23:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:11 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[22957019-d04f-4635-ba1c-243b781ba1b5]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79cd9fcf-d922-47ec-bec2-8af2f3067697_lsofd1cm {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:11 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD Jul 07 18:23:11 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:11 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79cd9fcf-d922-47ec-bec2-8af2f3067697_lsofd1cm Jul 07 18:23:11 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:11 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7" returned: 0 in 0.906s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:11 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7 Jul 07 18:23:11 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:11 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD" returned: 0 in 0.929s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:11 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79cd9fcf-d922-47ec-bec2-8af2f3067697_lsofd1cm" returned: 0 in 0.878s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79cd9fcf-d922-47ec-bec2-8af2f3067697_lsofd1cm {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:12 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be 1073741824" returned: 0 in 1.106s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:12 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD Jul 07 18:23:12 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:12 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79cd9fcf-d922-47ec-bec2-8af2f3067697_lsofd1cm Jul 07 18:23:12 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:12 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be Jul 07 18:23:12 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:12 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4ff066dd-274f-4dfd-b9c1-6c9693e739f7" returned: 0 in 0.852s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-4ff066dd-274f-4dfd-b9c1-6c9693e739f7" released by "delete_volume" :: held 1.807s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Created reservations ['cf336fbd-de33-4de7-b8c0-a695b0277a39', 'ca2c62eb-f1f5-44bf-895a-c0797390ff65', 'bbcd5e9e-f15c-41e6-b5df-c2cafe288d40', '61a7ecf2-691a-4518-9f08-a375f1eed93a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:12 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:12 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-2914d32d-c53e-4121-82f4-adcc17949b1d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-2914d32d-c53e-4121-82f4-adcc17949b1d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "cinder-quobyte-2914d32d-c53e-4121-82f4-adcc17949b1d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-2914d32d-c53e-4121-82f4-adcc17949b1d" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfc9e55-504d-4692-84f4-a47fa454559c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:12 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79cd9fcf-d922-47ec-bec2-8af2f3067697_lsofd1cm" returned: 1 in 0.918s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79cd9fcf-d922-47ec-bec2-8af2f3067697_lsofd1cm' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed1ed3-5d26-4daf-a652-7f09a37e117a]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:12 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD" returned: 1 in 1.019s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5 was raw, converting to raw {{(pid=86972) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:23:12 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:12 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:13 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 Jul 07 18:23:13 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:13 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d Jul 07 18:23:13 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD Jul 07 18:23:13 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:13 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:13 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be" returned: 0 in 0.970s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.366s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861851639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d409001a-851e-4b15-9b80-5cee245308ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:09Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Creating volume d409001a-851e-4b15-9b80-5cee245308ac {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:13 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d711d7f9-370a-4500-a007-61617e7eb6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a618616b-cc62-42c6-8436-3617e47e95be', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:13 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac 1073741824 Jul 07 18:23:13 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:13 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0706ef7-6f12-473a-9af2-b24e54299a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.893s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Deleted volume successfully. Jul 07 18:23:13 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume volume-a618616b-cc62-42c6-8436-3617e47e95be (a618616b-cc62-42c6-8436-3617e47e95be): created successfully Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0706ef7-6f12-473a-9af2-b24e54299a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (2d4b482c-c9f0-4971-8121-ba7ba2e0f693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f1de5417-33a0-44f2-aad5-0f9b987b86ef tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created volume successfully. Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-130d612d-0065-459c-ab96-12d3fff51b0c tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-4ff066dd-274f-4dfd-b9c1-6c9693e739f7-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:13 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.932s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:23:13 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d" returned: 0 in 1.024s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:13 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d Jul 07 18:23:13 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:14 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD" returned: 0 in 1.172s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:14 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD Jul 07 18:23:14 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:14 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" returned: 0 in 1.378s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5_h3wxn3_gdevstack@QuobyteHD, size 0.00 MB, duration 1.38 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:23:14 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:14 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 1G Jul 07 18:23:14 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:14 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac 1073741824" returned: 0 in 1.293s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:14 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac Jul 07 18:23:14 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:14 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2914d32d-c53e-4121-82f4-adcc17949b1d" returned: 0 in 0.745s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-quobyte-2914d32d-c53e-4121-82f4-adcc17949b1d" released by "delete_volume" :: held 1.829s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Created reservations ['fb6416f4-07a4-4a08-a37d-7088497c15e1', '0426baea-ba4b-4de9-98f9-6dfe791df784', 'fa4e71a8-09a5-4a84-bda5-867f88baf389', 'c34255e3-dbb7-4467-91fd-d6198089076c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:14 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:14 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:14 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD" returned: 1 in 0.954s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:23:14 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] 79cd9fcf-d922-47ec-bec2-8af2f3067697 was raw, converting to raw {{(pid=86972) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:15 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 Jul 07 18:23:15 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:15 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 1G" returned: 0 in 0.944s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1305aef-1962-44d8-a064-5f9fb2f32d14]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:15 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac" returned: 0 in 0.910s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.357s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1753969862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2710303e-c09a-4ebd-ac54-903e571924f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:09Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Creating volume 2710303e-c09a-4ebd-ac54-903e571924f5 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:15 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:15 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5 1073741824 Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9169374b-0929-4581-b5be-b910fb614298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d409001a-851e-4b15-9b80-5cee245308ac', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:15 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d80f1a-71b1-4d1c-9934-44ae6a166a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:15 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 Jul 07 18:23:15 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:15 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume volume-d409001a-851e-4b15-9b80-5cee245308ac (d409001a-851e-4b15-9b80-5cee245308ac): created successfully Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d80f1a-71b1-4d1c-9934-44ae6a166a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (0214d423-cbc0-4ec4-a218-398b2bb7ee34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c839d7b0-3924-426a-80d5-1a9068612ba0 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created volume successfully. Jul 07 18:23:15 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.897s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Deleted volume successfully. Jul 07 18:23:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-810f7ee9-cfa7-47c9-9ef6-632393537878 tempest-CreateVolumesFromImageTest-451826983 None] Lock "cinder-2914d32d-c53e-4121-82f4-adcc17949b1d-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:16 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4" returned: 0 in 1.148s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:16 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79cd9fcf-d922-47ec-bec2-8af2f3067697_5sbl97c2devstack@QuobyteHD, size 0.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:23:16 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 18:23:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:16 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 1G Jul 07 18:23:16 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:16 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" returned: 0 in 1.018s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:16 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 Jul 07 18:23:16 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:16 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5 1073741824" returned: 0 in 1.105s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:16 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5 Jul 07 18:23:16 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:17 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 1G" returned: 0 in 0.937s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5e70f1-5a4c-4a3b-ae72-1727ea3d318c]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:17 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 Jul 07 18:23:17 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:17 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" returned: 1 in 0.955s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Downloaded image ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'metadata': {}}])) to volume 14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 successfully. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Temporary image ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5 for user 057b3d3c289a4943817f34d81b69a075 is deleted. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Marking volume 14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 as bootable. {{(pid=86972) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Copying metadata from image ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5 to 14425fe6-d4d1-44d4-a5d4-bbe3fdce6719. {{(pid=86972) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Creating volume glance metadata for volume 14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 backed by image ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5 with: {'image_id': 'ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cfb4e14026c7304ccf57b7418e865728', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86972) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da646f89-640a-4e59-8e0e-7c32beb17e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719', 'volume_size': 1, 'image_id': 'ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfb4e14026c7304ccf57b7418e865728', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '562575e614de4e95ae49efbbf5132e9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '49e8c34c3caf3982032e2e3d0d5602c1067a8a416f552268f8b47086cdaa48b376ac649654390ac60d5a81d3900760a842d6ab9e8ad7c9b1ee49a6634cedc84d', 'id': 'ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5', 'created_at': datetime.datetime(2026, 7, 7, 16, 22, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 22, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ef150f0d-5cd1-47fc-8dd2-3c8cc96c01d5/file', 'properties': {}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a3e0ef-30bf-4612-8e2e-f21989b46feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:17 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Volume volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 (14425fe6-d4d1-44d4-a5d4-bbe3fdce6719): created successfully Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a3e0ef-30bf-4612-8e2e-f21989b46feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Flow 'volume_create_manager' (5c306ceb-c9bd-45c5-8889-f129c5b36f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-93cca90b-983a-469f-832e-0d6f39fd92e2 tempest-VolumeImageDependencyTests-2132475143 None] Created volume successfully. Jul 07 18:23:17 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5" returned: 0 in 0.974s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.819s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2039164304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b34b64e-9899-4c8a-b074-7e6acf5d7b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:09Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Creating volume 6b34b64e-9899-4c8a-b074-7e6acf5d7b6d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:17 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:17 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d 1073741824 Jul 07 18:23:17 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07207013-c499-44db-9d26-f89c716b4f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2710303e-c09a-4ebd-ac54-903e571924f5', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4127d3-2271-49d9-be4b-4503a991d0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:17 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume volume-2710303e-c09a-4ebd-ac54-903e571924f5 (2710303e-c09a-4ebd-ac54-903e571924f5): created successfully Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4127d3-2271-49d9-be4b-4503a991d0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:17 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (fa06f307-070e-4e8a-8f52-953e0ec05f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:17 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2bc80a61-d40a-4d76-8e25-5a7d4cb45105 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created volume successfully. Jul 07 18:23:18 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4" returned: 0 in 0.860s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:18 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 Jul 07 18:23:18 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Acquiring lock "cinder-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Lock "cinder-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Acquiring lock "cinder-quobyte-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Lock "cinder-quobyte-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3881ab26-5f9e-4a75-83d5-9e5227a47c34]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:18 devstack sudo[104567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 Jul 07 18:23:18 devstack sudo[104567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:18 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d 1073741824" returned: 0 in 1.113s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:18 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d Jul 07 18:23:18 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:19 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4" returned: 1 in 1.094s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Downloaded image 79cd9fcf-d922-47ec-bec2-8af2f3067697 ((None, [{'url': 'file:///opt/stack/data/glance/images/79cd9fcf-d922-47ec-bec2-8af2f3067697', 'metadata': {}}])) to volume 04010179-3ec2-4903-9848-0d343abec2d4 successfully. {{(pid=86972) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Temporary image 79cd9fcf-d922-47ec-bec2-8af2f3067697 for user 0e2a320db8e040f0a75c6c5e8b1d5685 is deleted. {{(pid=86972) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.volume_utils [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Marking volume 04010179-3ec2-4903-9848-0d343abec2d4 as bootable. {{(pid=86972) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Copying metadata from image 79cd9fcf-d922-47ec-bec2-8af2f3067697 to 04010179-3ec2-4903-9848-0d343abec2d4. {{(pid=86972) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Creating volume glance metadata for volume 04010179-3ec2-4903-9848-0d343abec2d4 backed by image 79cd9fcf-d922-47ec-bec2-8af2f3067697 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '79cd9fcf-d922-47ec-bec2-8af2f3067697', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bc9f57cc787ce82c671919bfbc7e57a6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86972) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827408dc-5cbb-488f-8cac-e846871f9570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04010179-3ec2-4903-9848-0d343abec2d4', 'volume_size': 1, 'image_id': '79cd9fcf-d922-47ec-bec2-8af2f3067697', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79cd9fcf-d922-47ec-bec2-8af2f3067697', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc9f57cc787ce82c671919bfbc7e57a6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6cf9ee4fc8bd48da80f54665b41bcf80', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd0e1f171540fa628c2ccc2e7c267df66305b25b951257b62b0306d49c6aea5cef6683306def917698a3452dbb2109e6d71aa1762fdf2b96c6a7e50182f2c20e1', 'id': '79cd9fcf-d922-47ec-bec2-8af2f3067697', 'created_at': datetime.datetime(2026, 7, 7, 16, 22, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 16, 22, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79cd9fcf-d922-47ec-bec2-8af2f3067697/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683a841e-5a08-4e84-9b65-32c1edcc7455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:19 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Volume volume-04010179-3ec2-4903-9848-0d343abec2d4 (04010179-3ec2-4903-9848-0d343abec2d4): created successfully Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (683a841e-5a08-4e84-9b65-32c1edcc7455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Flow 'volume_create_manager' (7bfcbaf6-b83f-4355-b582-729bc04194eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Flow 'volume_create_manager' (2a7a8e5d-ebf4-40e7-9249-3220aa6d0f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded01de1-439a-4eeb-b7cc-858b64d8ec62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-35d8ef7e-fdee-4310-92c3-dc9742811b78 tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Created volume successfully. Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded01de1-439a-4eeb-b7cc-858b64d8ec62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2039416288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8687c6-90ad-487c-99da-77879416ee42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a221efab34564911be284b83d8ffd998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:19Z,use_quota=True,user_id='29dcd10f3d93458d9559b257a9665f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:19 devstack sudo[104567]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d7589f-f7c6-41b1-a6b0-b0d48efd311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d7589f-f7c6-41b1-a6b0-b0d48efd311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3e75d0-f861-487b-8629-f9fec022d53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb3e75d0-f861-487b-8629-f9fec022d53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c8687c6-90ad-487c-99da-77879416ee42', 'volume_name': 'volume-2c8687c6-90ad-487c-99da-77879416ee42', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99aa413-4c09-4a33-86e5-6d089fc5add4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99aa413-4c09-4a33-86e5-6d089fc5add4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afb1d5d-9f64-4a58-a252-4010560aeb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:19 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Volume 2c8687c6-90ad-487c-99da-77879416ee42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c8687c6-90ad-487c-99da-77879416ee42', 'volume_size': 1} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" returned: 0 in 1.033s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Acquiring lock "cinder-04010179-3ec2-4903-9848-0d343abec2d4-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "cinder-04010179-3ec2-4903-9848-0d343abec2d4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:19 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d" returned: 0 in 0.891s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.541s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1929839672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e668b614-04df-4d8e-9122-6cb5da35006b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cfedb66dcf476e861e9a3f8a860d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:10Z,use_quota=True,user_id='8b05bca80285490b85e859acc7f41fc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Creating volume e668b614-04df-4d8e-9122-6cb5da35006b {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:19 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:19 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:19 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:19 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b 1073741824 Jul 07 18:23:19 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b2def86-5b92-4822-9da2-5c31b801de6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd585da-b11e-4c6d-95d9-5daad7242f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:19 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d (6b34b64e-9899-4c8a-b074-7e6acf5d7b6d): created successfully Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd585da-b11e-4c6d-95d9-5daad7242f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (4b5797e0-e44a-40b9-b550-e076412db43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Acquiring lock "cinder-quobyte-04010179-3ec2-4903-9848-0d343abec2d4" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e1370b7a-3320-412c-a604-3daa8cd0380b tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created volume successfully. Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "cinder-quobyte-04010179-3ec2-4903-9848-0d343abec2d4" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[62128fa8-95b1-4f1d-9d14-5a14025e3885]: (4, 'raw') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:19 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 Jul 07 18:23:19 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:20 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" returned: 1 in 0.882s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:23:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:20 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719 Jul 07 18:23:20 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:20 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b 1073741824" returned: 0 in 0.929s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:20 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:20 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b Jul 07 18:23:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:20 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:20 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 Jul 07 18:23:20 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:21 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" returned: 0 in 0.756s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Lock "cinder-quobyte-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719" released by "delete_volume" :: held 2.756s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Created reservations ['68156c22-81ab-4aed-a2cd-f21cdb71cc2f', '416a4cee-8e7d-43f8-9aed-724b0c5a3f34', 'f15f87cf-e002-4ed4-9bcf-4d10d3f96dab', 'ba991d6a-3234-439b-b2a5-0654723fe4cc'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:21 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:21 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:21 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b" returned: 0 in 0.702s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.856s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2039416288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8687c6-90ad-487c-99da-77879416ee42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a221efab34564911be284b83d8ffd998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:19Z,use_quota=True,user_id='29dcd10f3d93458d9559b257a9665f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Creating volume 2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:21 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48eb7ad4-60b3-4d3f-95ad-6422899a5448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e668b614-04df-4d8e-9122-6cb5da35006b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacce6e9-3bc1-42bb-acfd-278d315b9986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:21 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 1073741824 Jul 07 18:23:21 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:21 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Volume volume-e668b614-04df-4d8e-9122-6cb5da35006b (e668b614-04df-4d8e-9122-6cb5da35006b): created successfully Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacce6e9-3bc1-42bb-acfd-278d315b9986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Flow 'volume_create_manager' (957ae910-3dc9-4bd4-a4a5-cede8c438807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:21 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9fedcf51-c31d-45d5-bebc-eaeb00c51ded tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created volume successfully. Jul 07 18:23:21 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4" returned: 1 in 0.879s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4' failed. Not Retrying. {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 18:23:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:21 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4 Jul 07 18:23:21 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:22 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.792s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:22 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Deleted volume successfully. Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-bf94a40c-ae91-4f18-87ea-688716748d97 tempest-VolumeImageDependencyTests-2132475143 None] Lock "cinder-14425fe6-d4d1-44d4-a5d4-bbe3fdce6719-delete_volume" released by "delete_volume" :: held 3.808s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-e668b614-04df-4d8e-9122-6cb5da35006b-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-e668b614-04df-4d8e-9122-6cb5da35006b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-quobyte-e668b614-04df-4d8e-9122-6cb5da35006b" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-e668b614-04df-4d8e-9122-6cb5da35006b" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:22 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-04010179-3ec2-4903-9848-0d343abec2d4" returned: 0 in 0.805s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99fb448-c2fe-4153-9702-ce6a3441033e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "cinder-quobyte-04010179-3ec2-4903-9848-0d343abec2d4" released by "delete_volume" :: held 2.652s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Created reservations ['210dec7f-fed5-4309-a98c-04ccfa829f93', 'b03d0184-8cca-4bb7-b8ef-230a120e2622', '60747b31-ea47-4e05-bb83-957f6683b9f3', 'bd6d8466-eb80-4de7-8901-67ba23ae383d'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:22 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 1073741824" returned: 0 in 1.118s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:22 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b Jul 07 18:23:22 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:22 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 Jul 07 18:23:22 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:22 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:22 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:23 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b" returned: 0 in 1.071s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:23 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b Jul 07 18:23:23 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:23 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42" returned: 0 in 0.953s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afb1d5d-9f64-4a58-a252-4010560aeb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c8687c6-90ad-487c-99da-77879416ee42', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f550a9-f669-400e-9495-fa22e8581d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:23 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Volume volume-2c8687c6-90ad-487c-99da-77879416ee42 (2c8687c6-90ad-487c-99da-77879416ee42): created successfully Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f550a9-f669-400e-9495-fa22e8581d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Flow 'volume_create_manager' (2a7a8e5d-ebf4-40e7-9249-3220aa6d0f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:23 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.023s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Deleted volume successfully. Jul 07 18:23:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-85ab588d-a488-4b90-b962-ecc76dc66dbc tempest-VolumeDependencyTests-286697225 None] Created volume successfully. Jul 07 18:23:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8abb493-39aa-4952-bdac-001bfe50fe3c tempest-VolumeAndVolumeTypeFromImageTest-135270874 None] Lock "cinder-04010179-3ec2-4903-9848-0d343abec2d4-delete_volume" released by "delete_volume" :: held 4.071s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:24 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e668b614-04df-4d8e-9122-6cb5da35006b" returned: 0 in 0.778s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-e668b614-04df-4d8e-9122-6cb5da35006b" released by "delete_volume" :: held 1.919s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created reservations ['c77c9505-a67f-412f-8e73-3e82ced32b8a', '1d5ce89f-3db8-47e5-a5c8-4d92654205cb', 'd344504d-fbfe-47c1-a4c0-ae78028fcb5e', 'bdf8a937-635b-4057-8523-39d96a4b878c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:24 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:24 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-quobyte-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d" acquired by "delete_volume" :: waited 0.034s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc78cae7-8b84-4828-bdb2-722c03adca87]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:24 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d Jul 07 18:23:24 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Creating offline snapshot 07148d48-b68e-4bd9-a33e-d56e7748b5aa of volume 2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[67843de5-abcd-4420-b9f3-e5e846d18e33]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:25 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.972s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:25 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Deleted volume successfully. Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7d6cf482-c4ea-4d63-8b5e-e45c404d4419 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-e668b614-04df-4d8e-9122-6cb5da35006b-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:25 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 Jul 07 18:23:25 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:25 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d" returned: 0 in 1.184s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:25 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d Jul 07 18:23:25 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:26 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42" returned: 0 in 1.019s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:26 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa 1G Jul 07 18:23:26 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:26 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d" returned: 0 in 0.821s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d" released by "delete_volume" :: held 2.114s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created reservations ['833ba4b8-9d40-4a00-894d-6e1a383dea42', '0c543b12-38ee-42f3-97e5-e319771290de', '256ee6c3-70ae-4a1d-b649-e4ffca21809b', 'ea5aa867-45f4-41fd-8d61-853e270dac3e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:26 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:26 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-04f70c88-13de-4216-a317-7afcf529d964 tempest-ProjectAdminTests-1439575594 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710304260254, 'free_capacity_gb': 1775.710304260254, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86972) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 18:23:27 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa 1G" returned: 0 in 1.165s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c8687c6-90ad-487c-99da-77879416ee42 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:27 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c8687c6-90ad-487c-99da-77879416ee42 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa Jul 07 18:23:27 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:27 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.910s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:27 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Deleted volume successfully. Jul 07 18:23:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc1805c4-7c28-47ac-8bd9-76db714b2d7a tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-6b34b64e-9899-4c8a-b074-7e6acf5d7b6d-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-2710303e-c09a-4ebd-ac54-903e571924f5-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-2710303e-c09a-4ebd-ac54-903e571924f5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-quobyte-2710303e-c09a-4ebd-ac54-903e571924f5" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:28 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-2710303e-c09a-4ebd-ac54-903e571924f5" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:28 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceaaa4a-237a-4981-941e-d6631556c039]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:28 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5 Jul 07 18:23:28 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:28 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c8687c6-90ad-487c-99da-77879416ee42 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa" returned: 0 in 0.935s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:28 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa is being set with open permissions: ugo+rw Jul 07 18:23:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:28 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa Jul 07 18:23:28 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:29 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5" returned: 0 in 0.920s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:29 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5 Jul 07 18:23:29 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:29 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa" returned: 0 in 0.927s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:29 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.info Jul 07 18:23:29 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (f148affd-5885-46fc-a33d-730ea63256eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badcb044-175c-43ed-9ef9-dbbeb784e099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (badcb044-175c-43ed-9ef9-dbbeb784e099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-397757410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8898f19-b2e6-4395-886f-7aef8f1bcba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:30Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac370b1-917f-470c-9ddb-8bc472d92ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac370b1-917f-470c-9ddb-8bc472d92ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38954678-3a5b-4d5f-af47-843ce455f664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38954678-3a5b-4d5f-af47-843ce455f664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8898f19-b2e6-4395-886f-7aef8f1bcba9', 'volume_name': 'volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a8ce41-81c7-44f9-a805-de4960d9d094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a8ce41-81c7-44f9-a805-de4960d9d094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f97af4-6a7e-40a9-ac2f-1d0cdb22455a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:29 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume a8898f19-b2e6-4395-886f-7aef8f1bcba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9', 'volume_size': 1} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:29 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2710303e-c09a-4ebd-ac54-903e571924f5" returned: 0 in 0.908s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:29 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-2710303e-c09a-4ebd-ac54-903e571924f5" released by "delete_volume" :: held 1.881s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created reservations ['947174cc-5450-403a-951b-d7ccedc8bf3d', '9f8c4c44-e593-4042-a52e-acc2649e4a5b', 'd3491c3c-6c62-46e3-975c-3c9c89a719a3', '21b5eb9f-6e33-4b25-84fd-f488cade2605'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:30 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.info" returned: 0 in 0.813s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:30 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.info is being set with open permissions: ugo+rw Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:30 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:30 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:30 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.info Jul 07 18:23:30 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-d409001a-851e-4b15-9b80-5cee245308ac-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-d409001a-851e-4b15-9b80-5cee245308ac-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-quobyte-d409001a-851e-4b15-9b80-5cee245308ac" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-d409001a-851e-4b15-9b80-5cee245308ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bccba5-53d0-42d2-82f7-bdbcea68311f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:30 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac Jul 07 18:23:30 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:30 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.814s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:30 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Deleted volume successfully. Jul 07 18:23:30 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.info" returned: 0 in 0.819s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.824s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.246s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-397757410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8898f19-b2e6-4395-886f-7aef8f1bcba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:30Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Creating volume a8898f19-b2e6-4395-886f-7aef8f1bcba9 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:31 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e400bdeb-ed2c-40d8-bc6e-a5b16e196cc6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-2710303e-c09a-4ebd-ac54-903e571924f5-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:31 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 1073741824 Jul 07 18:23:31 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:31 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-4e5cc32b-a188-4ad4-a8ea-e3a5107dfb93 tempest-VolumeDependencyTests-286697225 None] Create snapshot completed successfully Jul 07 18:23:31 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac" returned: 0 in 0.928s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:31 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac Jul 07 18:23:31 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:32 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 1073741824" returned: 0 in 1.056s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:32 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 Jul 07 18:23:32 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:32 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-d409001a-851e-4b15-9b80-5cee245308ac" returned: 0 in 0.843s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-d409001a-851e-4b15-9b80-5cee245308ac" released by "delete_volume" :: held 1.853s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Flow 'volume_create_manager' (1e643d15-bca0-4e23-9d68-37f7ad647fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cc5e74-d71f-4227-9b87-bef23d290f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created reservations ['68fca793-5568-4def-b56e-fbb56338723c', '104b539e-0f0a-4ce3-9894-a38616376eb6', '61e23e7e-c78f-4fff-a010-c6854d6f0733', '3ad87443-60e2-40e9-a5fa-782f6036b511'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cc5e74-d71f-4227-9b87-bef23d290f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1981922453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ccee75-c8e7-44b4-9b55-e2e699820b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a221efab34564911be284b83d8ffd998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=07148d48-b68e-4bd9-a33e-d56e7748b5aa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:32Z,use_quota=True,user_id='29dcd10f3d93458d9559b257a9665f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54f8f66-e8c6-4750-a7f3-128e3a65f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54f8f66-e8c6-4750-a7f3-128e3a65f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948fb025-b2ae-4aa8-8b7d-f3e755b3e4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948fb025-b2ae-4aa8-8b7d-f3e755b3e4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94ccee75-c8e7-44b4-9b55-e2e699820b05', 'volume_name': 'volume-94ccee75-c8e7-44b4-9b55-e2e699820b05', 'volume_size': 1, 'snapshot_id': '07148d48-b68e-4bd9-a33e-d56e7748b5aa'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bae2d97-cafb-437e-ba8b-d3bce5d87456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bae2d97-cafb-437e-ba8b-d3bce5d87456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25812e3f-e224-4dbd-8837-966b30fd752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Volume 94ccee75-c8e7-44b4-9b55-e2e699820b05: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94ccee75-c8e7-44b4-9b55-e2e699820b05', 'volume_size': 1, 'snapshot_id': '07148d48-b68e-4bd9-a33e-d56e7748b5aa'} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:32 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:32 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-a618616b-cc62-42c6-8436-3617e47e95be-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-a618616b-cc62-42c6-8436-3617e47e95be-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-quobyte-a618616b-cc62-42c6-8436-3617e47e95be" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-a618616b-cc62-42c6-8436-3617e47e95be" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (1d1f2fae-3304-429d-89c7-6a6f73348023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ce7932-a157-44db-bf36-b26a4aa0f9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9135f3-dec9-4630-bb2d-4eb56c5186ae]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33ce7932-a157-44db-bf36-b26a4aa0f9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955006983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ca0777-4a26-4b5b-89ad-8362b44435e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:33Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593615cb-dd16-4a22-b23a-e328745dc558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593615cb-dd16-4a22-b23a-e328745dc558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7edf82c-f5d2-400c-8575-45cffe3dfb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7edf82c-f5d2-400c-8575-45cffe3dfb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ca0777-4a26-4b5b-89ad-8362b44435e8', 'volume_name': 'volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2c7496-50f6-4684-bcf7-1c4416f8396d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2c7496-50f6-4684-bcf7-1c4416f8396d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd053f6-061c-44d6-99e4-203d79220b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:32 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Volume b6ca0777-4a26-4b5b-89ad-8362b44435e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8', 'volume_size': 1} Jul 07 18:23:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:33 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be Jul 07 18:23:33 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:33 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9" returned: 0 in 0.925s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.651s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Acquiring lock "cinder-quobyte-07148d48-b68e-4bd9-a33e-d56e7748b5aa-94ccee75-c8e7-44b4-9b55-e2e699820b05" by "_create_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-07148d48-b68e-4bd9-a33e-d56e7748b5aa-94ccee75-c8e7-44b4-9b55-e2e699820b05" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Creating volume 94ccee75-c8e7-44b4-9b55-e2e699820b05 from snapshot 07148d48-b68e-4bd9-a33e-d56e7748b5aa {{(pid=86972) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Acquiring lock "cinder-quobyte-94ccee75-c8e7-44b4-9b55-e2e699820b05" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f97af4-6a7e-40a9-ac2f-1d0cdb22455a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a865c7-feab-4a17-a70d-ad52d7f99859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-94ccee75-c8e7-44b4-9b55-e2e699820b05" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] snapshot: 07148d48-b68e-4bd9-a33e-d56e7748b5aa, volume: 94ccee75-c8e7-44b4-9b55-e2e699820b05, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:23:33 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 (a8898f19-b2e6-4395-886f-7aef8f1bcba9): created successfully Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a865c7-feab-4a17-a70d-ad52d7f99859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (f148affd-5885-46fc-a33d-730ea63256eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-876d4707-8568-47b3-80cb-86f4243b4e4a tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created volume successfully. Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8857afdf-2d48-4fbb-8387-94b0805be142]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:33 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa Jul 07 18:23:33 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:33 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.861s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Deleted volume successfully. Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cc4729e7-3d6b-4112-a6d4-212b0c60e34c tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-d409001a-851e-4b15-9b80-5cee245308ac-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:33 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be" returned: 0 in 0.847s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:33 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be Jul 07 18:23:33 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:34 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa" returned: 0 in 0.875s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c8687c6-90ad-487c-99da-77879416ee42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d828727b-c500-4b6a-b75c-9c5079140272]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:34 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 Jul 07 18:23:34 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:34 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a618616b-cc62-42c6-8436-3617e47e95be" returned: 0 in 0.741s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-a618616b-cc62-42c6-8436-3617e47e95be" released by "delete_volume" :: held 1.673s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (341c12b1-04d1-45d3-9646-c85a9edd55a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36c2000-23fa-43f7-8256-95a8ff5543ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36c2000-23fa-43f7-8256-95a8ff5543ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988462989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98066100-0d1a-449d-bedd-90b935c2a496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:34Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80b0959-326e-4622-aecd-f1a64dbc4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80b0959-326e-4622-aecd-f1a64dbc4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1b583a-b0de-4496-8467-c432425e6c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1b583a-b0de-4496-8467-c432425e6c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98066100-0d1a-449d-bedd-90b935c2a496', 'volume_name': 'volume-98066100-0d1a-449d-bedd-90b935c2a496', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9719e975-4034-483c-8b56-c1041f3e8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9719e975-4034-483c-8b56-c1041f3e8643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f272c17-aec8-42cf-b8ad-7e3d02d9363d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:34 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume 98066100-0d1a-449d-bedd-90b935c2a496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98066100-0d1a-449d-bedd-90b935c2a496', 'volume_size': 1} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created reservations ['49edbc33-0557-481c-a25f-50fcb1fe8038', '8ccb5c16-4bf2-4261-99ee-f1fbaa57d2e1', 'd9aaec08-3afd-4fb9-8e61-3476449a9303', 'e7fdedf8-547e-4e08-9463-e58ff05fef14'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:34 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:34 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (fb2829e6-4ece-4178-b261-0d66ef580e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9822c8c-c659-406a-a8b4-8e181f3c2ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9822c8c-c659-406a-a8b4-8e181f3c2ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-463205259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9814f1c4-e4fe-40ac-b605-c77c5c10214b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:35Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17527aa-a6eb-4290-9cf6-923e127b007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17527aa-a6eb-4290-9cf6-923e127b007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8b13f1-95a0-4297-9797-ccd023f11df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8b13f1-95a0-4297-9797-ccd023f11df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9814f1c4-e4fe-40ac-b605-c77c5c10214b', 'volume_name': 'volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4076179-3cb8-4eb4-8216-26047aab4166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4076179-3cb8-4eb4-8216-26047aab4166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f98cbb0-9c76-4734-9d3c-d2033233f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume 9814f1c4-e4fe-40ac-b605-c77c5c10214b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b', 'volume_size': 1} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-58d7b262-39a2-4bd2-9af8-d9663eb258ff-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-58d7b262-39a2-4bd2-9af8-d9663eb258ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-quobyte-34c94fc3-ac52-4421-bbff-12ab916a1f55" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-34c94fc3-ac52-4421-bbff-12ab916a1f55" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-quobyte-58d7b262-39a2-4bd2-9af8-d9663eb258ff" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-58d7b262-39a2-4bd2-9af8-d9663eb258ff" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Deleting offline snapshot 58d7b262-39a2-4bd2-9af8-d9663eb258ff of volume 34c94fc3-ac52-4421-bbff-12ab916a1f55 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:23:35 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] snapshot_file for this snap is: volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42" returned: 0 in 1.055s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfdced6-b37e-41a7-85c7-5116da741540]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:35 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 Jul 07 18:23:35 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:35 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff Jul 07 18:23:35 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (ef748fe2-6055-4f93-97ef-d48f08a4ef1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddf85af-4fe9-4c80-969f-a8c2a7f2fbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddf85af-4fe9-4c80-969f-a8c2a7f2fbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682141964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af065ff-0d49-4bd9-9d5c-e97a9896dcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:35Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b20580-356b-40a9-a421-db70058442d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b20580-356b-40a9-a421-db70058442d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a7c1c4-2f8b-4dda-b266-3bbf68796c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a7c1c4-2f8b-4dda-b266-3bbf68796c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3af065ff-0d49-4bd9-9d5c-e97a9896dcec', 'volume_name': 'volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c818b8c9-5980-4c1f-9ee3-639571a55cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c818b8c9-5980-4c1f-9ee3-639571a55cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9edc6f5-54d1-4f8c-bb13-ab3b122303d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:35 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume 3af065ff-0d49-4bd9-9d5c-e97a9896dcec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec', 'volume_size': 1} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:35 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.991s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Deleted volume successfully. Jul 07 18:23:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f3d5a862-b705-44f4-a9f1-c13b5e0f57e6 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-a618616b-cc62-42c6-8436-3617e47e95be-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (280ede6a-3112-4aee-ae77-40588a3f2240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17476577-292c-4001-b909-35c7f0d01097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17476577-292c-4001-b909-35c7f0d01097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000296339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d8a376-09c7-4a32-9d8b-799f8cab642c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:36Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27cac26-a48e-452b-99ab-3e23ec2fbe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27cac26-a48e-452b-99ab-3e23ec2fbe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab333b7-8308-43f5-b46b-7d3ca4e8473e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab333b7-8308-43f5-b46b-7d3ca4e8473e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d8a376-09c7-4a32-9d8b-799f8cab642c', 'volume_name': 'volume-90d8a376-09c7-4a32-9d8b-799f8cab642c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f79632-eb5e-4d7b-b490-7664399efbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f79632-eb5e-4d7b-b490-7664399efbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ceb3c4-c1b4-4c4a-87a7-a892a5d81d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:36 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume 90d8a376-09c7-4a32-9d8b-799f8cab642c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d8a376-09c7-4a32-9d8b-799f8cab642c', 'volume_size': 1} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:36 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff" returned: 0 in 1.149s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34c94fc3-ac52-4421-bbff-12ab916a1f55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a027ff24-839a-47d1-a59b-80d2b1b49a12]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:36 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 Jul 07 18:23:36 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:36 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (6aaf51e0-3c45-43ba-bf51-da6a939726d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da88447-5416-44cb-b7b0-ec45529b55a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da88447-5416-44cb-b7b0-ec45529b55a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1726337969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aedd41c-28bb-4b8b-af0c-74941ec19bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:37Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70f9c5c-ad8f-4187-bccd-fff5812e04f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70f9c5c-ad8f-4187-bccd-fff5812e04f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e043a6-20f2-4afb-99f8-8c1eef9921fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e043a6-20f2-4afb-99f8-8c1eef9921fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aedd41c-28bb-4b8b-af0c-74941ec19bcf', 'volume_name': 'volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eebf8e-0255-4f57-a549-26465a113e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13eebf8e-0255-4f57-a549-26465a113e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c6b0cb-f0de-4dc6-8506-8f3230b87628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:37 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume 5aedd41c-28bb-4b8b-af0c-74941ec19bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf', 'volume_size': 1} Jul 07 18:23:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:38 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55" returned: 0 in 1.864s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:38 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff Jul 07 18:23:38 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:39 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff" returned: 0 in 1.606s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:39 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff Jul 07 18:23:39 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:40 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05" returned: 0 in 5.426s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:40 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a4da9f-4fac-4bd5-ab36-556d30851a71]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:40 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 Jul 07 18:23:40 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:40 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55.58d7b262-39a2-4bd2-9af8-d9663eb258ff" returned: 0 in 0.973s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-58d7b262-39a2-4bd2-9af8-d9663eb258ff" released by "_delete_snapshot" :: held 5.801s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-34c94fc3-ac52-4421-bbff-12ab916a1f55" released by "delete_snapshot" :: held 5.846s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:40 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=117,cinder:UPDATE=150,cinder:INSERT=36,cinder:DELETE=18 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created reservations ['6e2ddcd7-cf57-4113-848a-015f3a42f77f', 'd52e40f2-edb6-4fa7-a9bd-583526938f73', 'e7dab14e-1346-4f55-9922-fb6565622da7', '73d05942-c6b8-41ad-a311-6a5eb0d6bdc4'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:41 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Delete snapshot completed successfully. Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-21848ba4-80ac-4028-be59-794215c30388 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-58d7b262-39a2-4bd2-9af8-d9663eb258ff-delete_snapshot" released by "delete_snapshot" :: held 6.036s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-34c94fc3-ac52-4421-bbff-12ab916a1f55-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:41 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42" returned: 0 in 0.978s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:23:41 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Converted 1024.00 MB image at 188.67 MB/s Jul 07 18:23:41 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 is being set with open permissions: ugo+rw Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-34c94fc3-ac52-4421-bbff-12ab916a1f55-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:41 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 Jul 07 18:23:41 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "cinder-quobyte-34c94fc3-ac52-4421-bbff-12ab916a1f55" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-34c94fc3-ac52-4421-bbff-12ab916a1f55" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0765635-3bfd-4124-ab3c-37ace87f8a50]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:41 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 Jul 07 18:23:41 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:42 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05" returned: 0 in 0.733s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-94ccee75-c8e7-44b4-9b55-e2e699820b05" released by "_copy_volume_from_snapshot" :: held 9.212s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-07148d48-b68e-4bd9-a33e-d56e7748b5aa-94ccee75-c8e7-44b4-9b55-e2e699820b05" released by "_create_volume_from_snapshot" :: held 9.273s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.295s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.372s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1955006983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ca0777-4a26-4b5b-89ad-8362b44435e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:33Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Creating volume b6ca0777-4a26-4b5b-89ad-8362b44435e8 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:42 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:42 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 1073741824 Jul 07 18:23:42 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25812e3f-e224-4dbd-8837-966b30fd752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ccee75-c8e7-44b4-9b55-e2e699820b05', 'volume_size': 1, 'snapshot_id': '07148d48-b68e-4bd9-a33e-d56e7748b5aa'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb49855b-26b1-4529-b069-582a6fd59d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:42 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Volume volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 (94ccee75-c8e7-44b4-9b55-e2e699820b05): created successfully Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb49855b-26b1-4529-b069-582a6fd59d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Flow 'volume_create_manager' (1e643d15-bca0-4e23-9d68-37f7ad647fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-853d9d95-1fc8-4c64-861c-c041aad75762 tempest-VolumeDependencyTests-286697225 None] Created volume successfully. Jul 07 18:23:42 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55" returned: 0 in 0.803s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:42 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55 Jul 07 18:23:42 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:43 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-34c94fc3-ac52-4421-bbff-12ab916a1f55" returned: 0 in 0.747s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Acquiring lock "cinder-07148d48-b68e-4bd9-a33e-d56e7748b5aa-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-quobyte-34c94fc3-ac52-4421-bbff-12ab916a1f55" released by "delete_volume" :: held 1.636s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Lock "cinder-07148d48-b68e-4bd9-a33e-d56e7748b5aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Acquiring lock "cinder-quobyte-2c8687c6-90ad-487c-99da-77879416ee42" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:43 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 1073741824" returned: 0 in 0.993s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-2c8687c6-90ad-487c-99da-77879416ee42" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Acquiring lock "cinder-quobyte-07148d48-b68e-4bd9-a33e-d56e7748b5aa" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-07148d48-b68e-4bd9-a33e-d56e7748b5aa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Deleting offline snapshot 07148d48-b68e-4bd9-a33e-d56e7748b5aa of volume 2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] snapshot_file for this snap is: volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[1057b27c-15e5-4f9b-9af4-e1aefbb61662]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Created reservations ['ff4301e0-0004-4ff8-ae1a-3aed5beaff7c', '0f60df83-85c7-49e7-b3a0-e32866e6189a', '89a8695f-85b7-47ac-bdd3-bc47069340d9', '5008d741-eef5-47c1-a363-5ea8bab3e6e6'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:43 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 Jul 07 18:23:43 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:43 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa Jul 07 18:23:43 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:43 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:43 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:44 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8" returned: 0 in 0.795s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.635s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988462989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98066100-0d1a-449d-bedd-90b935c2a496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:34Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Creating volume 98066100-0d1a-449d-bedd-90b935c2a496 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:44 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:44 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496 1073741824 Jul 07 18:23:44 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd053f6-061c-44d6-99e4-203d79220b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c47c0b4-dc07-4bd2-bf28-00f6758fc97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:44 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Volume volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 (b6ca0777-4a26-4b5b-89ad-8362b44435e8): created successfully Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c47c0b4-dc07-4bd2-bf28-00f6758fc97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (1d1f2fae-3304-429d-89c7-6a6f73348023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b088c37c-e68e-4d2f-9fba-980d5c1cd929 tempest-ProjectReaderTests-1911194062 None] Created volume successfully. Jul 07 18:23:44 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.834s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Deleted volume successfully. Jul 07 18:23:44 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa" returned: 0 in 1.009s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c8687c6-90ad-487c-99da-77879416ee42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a294268e-eab0-4e94-a1f0-fdaac835b04e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-46143f58-8e56-4665-83b5-916da4468e23 tempest-CreateVolumesFromSnapshotTest-1483988562 None] Lock "cinder-34c94fc3-ac52-4421-bbff-12ab916a1f55-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:44 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 Jul 07 18:23:44 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:45 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496 1073741824" returned: 0 in 1.098s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:45 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496 Jul 07 18:23:45 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:45 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42" returned: 0 in 1.024s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:45 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa Jul 07 18:23:45 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:46 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496" returned: 0 in 0.779s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.935s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.190s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-463205259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9814f1c4-e4fe-40ac-b605-c77c5c10214b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:35Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Creating volume 9814f1c4-e4fe-40ac-b605-c77c5c10214b {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:46 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:46 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b 1073741824 Jul 07 18:23:46 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f272c17-aec8-42cf-b8ad-7e3d02d9363d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98066100-0d1a-449d-bedd-90b935c2a496', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43daa6e3-4f19-49e4-9209-da13f6aa420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:46 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume volume-98066100-0d1a-449d-bedd-90b935c2a496 (98066100-0d1a-449d-bedd-90b935c2a496): created successfully Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43daa6e3-4f19-49e4-9209-da13f6aa420c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (341c12b1-04d1-45d3-9646-c85a9edd55a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:46 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d36fc5a7-a988-4410-b96a-c6c66f292348 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created volume successfully. Jul 07 18:23:46 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa" returned: 0 in 0.901s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:46 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa Jul 07 18:23:46 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:47 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42.07148d48-b68e-4bd9-a33e-d56e7748b5aa" returned: 0 in 0.790s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:47 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b 1073741824" returned: 0 in 1.050s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Flow 'volume_create_manager' (acca45e1-2a42-4350-8e41-4480ae6a6af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acf335c-6c3a-4c61-b60e-db05caa9aae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-07148d48-b68e-4bd9-a33e-d56e7748b5aa" released by "_delete_snapshot" :: held 3.930s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-2c8687c6-90ad-487c-99da-77879416ee42" released by "delete_snapshot" :: held 3.972s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acf335c-6c3a-4c61-b60e-db05caa9aae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3613f176-60a8-4d41-82ef-5c9f5d1c90a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694fcfb82a224180b166ae51cb3b0bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:47Z,use_quota=True,user_id='8feabe4da12b4e6393ffde061db5976d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e09b2ef-5255-4b2e-881c-414fa892fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e09b2ef-5255-4b2e-881c-414fa892fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fe0bf7-19c9-4a5d-b44b-fa6e594540c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59fe0bf7-19c9-4a5d-b44b-fa6e594540c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3613f176-60a8-4d41-82ef-5c9f5d1c90a2', 'volume_name': 'volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a440b9-1384-42e4-92bc-030e76f8c08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a440b9-1384-42e4-92bc-030e76f8c08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa90242b-cb98-4dc5-9a3d-631e62cb927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:47 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Volume 3613f176-60a8-4d41-82ef-5c9f5d1c90a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2', 'volume_size': 1} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:47 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b Jul 07 18:23:47 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Created reservations ['2413fcb9-2f94-4cc2-8e4b-e34431fb8a2b', 'db40c837-624b-4c36-8a91-12d7c358ead7', 'dbe529e9-e8f7-4675-aee4-cb4ca584f8b8', '7b7afcb5-273f-473b-be3d-2d3eac7c6eb8'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:47 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Delete snapshot completed successfully. Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-af5ced7e-da3f-4206-9422-f5a32883490c tempest-VolumeDependencyTests-286697225 None] Lock "cinder-07148d48-b68e-4bd9-a33e-d56e7748b5aa-delete_snapshot" released by "delete_snapshot" :: held 4.233s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Acquiring lock "cinder-2c8687c6-90ad-487c-99da-77879416ee42-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Lock "cinder-2c8687c6-90ad-487c-99da-77879416ee42-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Acquiring lock "cinder-quobyte-2c8687c6-90ad-487c-99da-77879416ee42" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-2c8687c6-90ad-487c-99da-77879416ee42" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf8248-2cb3-4aa2-aa05-0f6dea10cbe8]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:47 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 Jul 07 18:23:47 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:48 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b" returned: 0 in 0.757s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.542s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682141964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af065ff-0d49-4bd9-9d5c-e97a9896dcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:35Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Creating volume 3af065ff-0d49-4bd9-9d5c-e97a9896dcec {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:48 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f98cbb0-9c76-4734-9d3c-d2033233f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:48 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec 1073741824 Jul 07 18:23:48 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6296edb9-f638-451b-be70-d8b6f5d5a82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:48 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b (9814f1c4-e4fe-40ac-b605-c77c5c10214b): created successfully Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6296edb9-f638-451b-be70-d8b6f5d5a82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (fb2829e6-4ece-4178-b261-0d66ef580e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:48 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c081a0d7-d686-40b8-b1e2-5b31e24d589f tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created volume successfully. Jul 07 18:23:48 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42" returned: 0 in 0.783s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:48 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42 Jul 07 18:23:48 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:49 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec 1073741824" returned: 0 in 0.884s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:49 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec Jul 07 18:23:49 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:49 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2c8687c6-90ad-487c-99da-77879416ee42" returned: 0 in 0.717s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-2c8687c6-90ad-487c-99da-77879416ee42" released by "delete_volume" :: held 1.575s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Created reservations ['e51b3dfe-45e8-451f-b487-7387e0c6c9c5', '06459c42-b1a4-41ca-b38a-3d6c5c8de55a', '408170f8-b6aa-4787-ac7f-c58e97ecf799', '24780d7c-d9c5-4c50-b8d0-f241452f6bec'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:49 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:49 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Acquiring lock "cinder-94ccee75-c8e7-44b4-9b55-e2e699820b05-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:49 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec" returned: 0 in 0.773s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.727s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000296339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d8a376-09c7-4a32-9d8b-799f8cab642c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:36Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Creating volume 90d8a376-09c7-4a32-9d8b-799f8cab642c {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:49 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Lock "cinder-94ccee75-c8e7-44b4-9b55-e2e699820b05-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:49 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c 1073741824 Jul 07 18:23:49 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9edc6f5-54d1-4f8c-bb13-ab3b122303d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a398b4-2f47-4067-a94d-137b934c778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:49 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec (3af065ff-0d49-4bd9-9d5c-e97a9896dcec): created successfully Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a398b4-2f47-4067-a94d-137b934c778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (ef748fe2-6055-4f93-97ef-d48f08a4ef1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Acquiring lock "cinder-quobyte-94ccee75-c8e7-44b4-9b55-e2e699820b05" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:50 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-87803074-cf23-4e84-bb59-e644bb3c1e12 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created volume successfully. Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-94ccee75-c8e7-44b4-9b55-e2e699820b05" acquired by "delete_volume" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45eb6a2-47eb-4330-be31-adf6d5bbabc7]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:50 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.724s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:50 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Deleted volume successfully. Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ce0fa893-e9bc-4a3e-99da-3fb311dead3d tempest-VolumeDependencyTests-286697225 None] Lock "cinder-2c8687c6-90ad-487c-99da-77879416ee42-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:50 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 Jul 07 18:23:50 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:50 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c 1073741824" returned: 0 in 0.943s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=196,cinder:SELECT=147,cinder:INSERT=57,cinder:DELETE=15 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:50 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c Jul 07 18:23:50 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:50 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05" returned: 0 in 0.845s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:50 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05 Jul 07 18:23:50 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:51 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:51 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.242s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1726337969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aedd41c-28bb-4b8b-af0c-74941ec19bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3d88320fc194868a49b5aee284f3874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:37Z,use_quota=True,user_id='7d0745f77a6643a78b120239b6b797ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Creating volume 5aedd41c-28bb-4b8b-af0c-74941ec19bcf {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:51 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-94ccee75-c8e7-44b4-9b55-e2e699820b05" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61ceb3c4-c1b4-4c4a-87a7-a892a5d81d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d8a376-09c7-4a32-9d8b-799f8cab642c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:51 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf 1073741824 Jul 07 18:23:51 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9927d1c9-cb5e-4170-a89c-b96754c4f7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Lock "cinder-quobyte-94ccee75-c8e7-44b4-9b55-e2e699820b05" released by "delete_volume" :: held 1.610s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:51 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume volume-90d8a376-09c7-4a32-9d8b-799f8cab642c (90d8a376-09c7-4a32-9d8b-799f8cab642c): created successfully Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9927d1c9-cb5e-4170-a89c-b96754c4f7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (280ede6a-3112-4aee-ae77-40588a3f2240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8a60970a-9820-4135-ae49-7dbaf23acff2 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created volume successfully. Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Created reservations ['39408c2f-febf-43ba-aafb-bc98440464ff', '0b45b140-974d-4fd9-9f7e-aedd089e3573', '6c021496-2879-4416-9d45-350e3da9ea91', 'a49e5868-98e6-4ae4-a0e4-53e34a0cd57e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:51 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:51 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:52 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf 1073741824" returned: 0 in 0.969s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:52 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.738s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:52 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:52 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Deleted volume successfully. Jul 07 18:23:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-63335fcb-54db-41f3-b30a-5d2d0cb16aea tempest-VolumeDependencyTests-286697225 None] Lock "cinder-94ccee75-c8e7-44b4-9b55-e2e699820b05-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:52 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf Jul 07 18:23:52 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:53 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf" returned: 0 in 0.653s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.201s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69c6b0cb-f0de-4dc6-8506-8f3230b87628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf9c9ec-16c1-4a6d-a751-c5375733910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Creating offline snapshot a05535a0-bdf1-4148-801e-1ee8b91255b0 of volume b6ca0777-4a26-4b5b-89ad-8362b44435e8 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:23:53 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Volume volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf (5aedd41c-28bb-4b8b-af0c-74941ec19bcf): created successfully Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf9c9ec-16c1-4a6d-a751-c5375733910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Flow 'volume_create_manager' (6aaf51e0-3c45-43ba-bf51-da6a939726d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd790a6-9fe6-4d86-b815-88c45811002f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:53 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c1f2d588-ca36-4f7c-8479-4c93358c5389 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created volume successfully. Jul 07 18:23:53 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 Jul 07 18:23:53 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-5aedd41c-28bb-4b8b-af0c-74941ec19bcf-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-5aedd41c-28bb-4b8b-af0c-74941ec19bcf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-quobyte-5aedd41c-28bb-4b8b-af0c-74941ec19bcf" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-5aedd41c-28bb-4b8b-af0c-74941ec19bcf" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:54 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8" returned: 0 in 0.962s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:54 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0474d407-5139-45b8-92d0-8165aa913fc8]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:54 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 1G Jul 07 18:23:54 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:54 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf Jul 07 18:23:54 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:55 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf" returned: 0 in 0.926s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:55 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 1G" returned: 0 in 0.965s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:55 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf Jul 07 18:23:55 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:55 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 Jul 07 18:23:55 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:56 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-5aedd41c-28bb-4b8b-af0c-74941ec19bcf" returned: 0 in 0.788s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-5aedd41c-28bb-4b8b-af0c-74941ec19bcf" released by "delete_volume" :: held 1.767s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created reservations ['97a0ebb4-5dee-4d8e-b58b-5a5b2e0e12a6', '53581716-812e-45c3-97fd-f3cccfb77f1d', 'da4a80da-7ba7-4bd3-9de7-69050dbb6f04', '93a9cb85-5b08-4407-a3a8-77152725bef6'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:56 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0" returned: 0 in 0.845s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:56 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 is being set with open permissions: ugo+rw Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:56 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 Jul 07 18:23:56 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:56 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:56 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-90d8a376-09c7-4a32-9d8b-799f8cab642c-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-90d8a376-09c7-4a32-9d8b-799f8cab642c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-quobyte-90d8a376-09c7-4a32-9d8b-799f8cab642c" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-90d8a376-09c7-4a32-9d8b-799f8cab642c" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a73c8e-77c8-45df-8954-0e04f9689a32]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:56 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c Jul 07 18:23:56 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:56 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0" returned: 0 in 0.828s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:56 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.760s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:56 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:56 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Deleted volume successfully. Jul 07 18:23:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c4004eb5-d693-4590-a244-6a416eaa4f35 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-5aedd41c-28bb-4b8b-af0c-74941ec19bcf-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:57 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.info Jul 07 18:23:57 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:57 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c" returned: 0 in 0.864s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:57 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c Jul 07 18:23:57 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:57 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.info" returned: 0 in 0.792s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:57 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.info is being set with open permissions: ugo+rw Jul 07 18:23:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:57 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.info Jul 07 18:23:57 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:58 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-90d8a376-09c7-4a32-9d8b-799f8cab642c" returned: 0 in 0.799s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-90d8a376-09c7-4a32-9d8b-799f8cab642c" released by "delete_volume" :: held 1.709s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created reservations ['9f361b05-d59e-465d-b23e-dd5894d2e05f', '3c35eef5-da6d-48db-90d0-50bef8a596ce', '39290cf8-44be-4f06-83d4-7697f683f784', 'ea97343c-ae28-4376-b7e5-a72ff0c1c9cc'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:58 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:23:58 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:58 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.info" returned: 0 in 0.788s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.342s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.251s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3613f176-60a8-4d41-82ef-5c9f5d1c90a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694fcfb82a224180b166ae51cb3b0bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:23:47Z,use_quota=True,user_id='8feabe4da12b4e6393ffde061db5976d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Creating volume 3613f176-60a8-4d41-82ef-5c9f5d1c90a2 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:23:58 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:58 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 1073741824 Jul 07 18:23:58 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:58 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-13ea67eb-df46-4a49-822f-24b7c2f0b29f tempest-ProjectReaderTests-1911194062 None] Create snapshot completed successfully Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-3af065ff-0d49-4bd9-9d5c-e97a9896dcec-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-3af065ff-0d49-4bd9-9d5c-e97a9896dcec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-quobyte-3af065ff-0d49-4bd9-9d5c-e97a9896dcec" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-3af065ff-0d49-4bd9-9d5c-e97a9896dcec" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[66883e8b-258d-4ab5-b9b9-f4ba5712bc3d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:23:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:59 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec Jul 07 18:23:59 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:59 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.784s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:23:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Deleted volume successfully. Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ca33be86-eda3-427b-8397-b6ba48704abd tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-90d8a376-09c7-4a32-9d8b-799f8cab642c-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:23:59 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 1073741824" returned: 0 in 1.214s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-a05535a0-bdf1-4148-801e-1ee8b91255b0-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:59 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 Jul 07 18:23:59 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-a05535a0-bdf1-4148-801e-1ee8b91255b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-b6ca0777-4a26-4b5b-89ad-8362b44435e8" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:23:59 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-b6ca0777-4a26-4b5b-89ad-8362b44435e8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:23:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-a05535a0-bdf1-4148-801e-1ee8b91255b0" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec" returned: 0 in 1.019s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-a05535a0-bdf1-4148-801e-1ee8b91255b0" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:00 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec Jul 07 18:24:00 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Deleting offline snapshot a05535a0-bdf1-4148-801e-1ee8b91255b0 of volume b6ca0777-4a26-4b5b-89ad-8362b44435e8 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] snapshot_file for this snap is: volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37b1f43-2974-46ba-93b4-876e7f967840]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:00 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 Jul 07 18:24:00 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:00 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2" returned: 0 in 0.880s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa90242b-cb98-4dc5-9a3d-631e62cb927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dafc493-e7de-422e-b9e7-db665756ddd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:00 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Volume volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 (3613f176-60a8-4d41-82ef-5c9f5d1c90a2): created successfully Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dafc493-e7de-422e-b9e7-db665756ddd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Flow 'volume_create_manager' (acca45e1-2a42-4350-8e41-4480ae6a6af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:00 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3af065ff-0d49-4bd9-9d5c-e97a9896dcec" returned: 0 in 0.828s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:00 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2d4428d3-b195-4a6c-a5e3-23de0f7972a5 tempest-CinderUnicodeTest-1351033245 None] Created volume successfully. Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-3af065ff-0d49-4bd9-9d5c-e97a9896dcec" released by "delete_volume" :: held 1.928s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created reservations ['fb61b0d4-86c3-4029-b3be-a4f59cde78ea', 'c7cf028e-bc94-4ba4-a0a8-b1a5cf349a19', '270f5e8b-f6d2-4d48-acf7-de5a57548886', 'aab44945-9cb9-4ca2-984f-9f9d249f9d1b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:00 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0" returned: 0 in 0.861s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:24:01 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:01 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aa8c65-c9af-43dc-ae33-24447ed453cd]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:01 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 Jul 07 18:24:01 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-9814f1c4-e4fe-40ac-b605-c77c5c10214b-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-9814f1c4-e4fe-40ac-b605-c77c5c10214b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-quobyte-9814f1c4-e4fe-40ac-b605-c77c5c10214b" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-9814f1c4-e4fe-40ac-b605-c77c5c10214b" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b15e81-dbad-42cc-85b2-82c38def7535]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:01 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b Jul 07 18:24:01 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:01 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.873s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:01 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Deleted volume successfully. Jul 07 18:24:01 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6e60f459-c73d-44e8-84e2-1bfd10fb772b tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-3af065ff-0d49-4bd9-9d5c-e97a9896dcec-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:02 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8" returned: 0 in 1.090s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:02 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 Jul 07 18:24:02 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Flow 'volume_create_manager' (d40ff227-6895-4ba9-b9ce-f6e522d7f2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4ada76-1cce-427c-8e0f-d3a5439dfa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4ada76-1cce-427c-8e0f-d3a5439dfa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-770999007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d46f14-d644-4173-8ec1-82161cda301c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694fcfb82a224180b166ae51cb3b0bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:02Z,use_quota=True,user_id='8feabe4da12b4e6393ffde061db5976d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a918203-0e31-4b55-a656-8f4ebcbadae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a918203-0e31-4b55-a656-8f4ebcbadae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186da58e-ed3e-4882-b75d-22803640fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186da58e-ed3e-4882-b75d-22803640fee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d46f14-d644-4173-8ec1-82161cda301c', 'volume_name': 'volume-35d46f14-d644-4173-8ec1-82161cda301c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c32ae16-0c94-4100-a319-1ed4a3705ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c32ae16-0c94-4100-a319-1ed4a3705ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105b0825-c0ca-4edb-a5ba-f831b0f6bbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:02 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Volume 35d46f14-d644-4173-8ec1-82161cda301c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d46f14-d644-4173-8ec1-82161cda301c', 'volume_size': 1} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-770999007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d46f14-d644-4173-8ec1-82161cda301c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694fcfb82a224180b166ae51cb3b0bfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:02Z,use_quota=True,user_id='8feabe4da12b4e6393ffde061db5976d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Creating volume 35d46f14-d644-4173-8ec1-82161cda301c {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:24:02 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:02 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c 1073741824 Jul 07 18:24:02 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:02 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b" returned: 0 in 1.081s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:02 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b Jul 07 18:24:02 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:03 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0" returned: 0 in 0.989s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:03 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0 Jul 07 18:24:03 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:03 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9814f1c4-e4fe-40ac-b605-c77c5c10214b" returned: 0 in 0.918s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-9814f1c4-e4fe-40ac-b605-c77c5c10214b" released by "delete_volume" :: held 2.093s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:03 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c 1073741824" returned: 0 in 1.199s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created reservations ['04b417d7-5489-4a76-955d-c958835642c5', '1ae8fbbd-27b8-48fe-9dbc-84fce7a457ee', '28a83531-160a-4d9d-adc2-89f4748fe7bc', 'f34dbed4-ff0a-4c95-932d-5183301aeb2c'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:03 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c Jul 07 18:24:03 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:03 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:03 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:04 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8.a05535a0-bdf1-4148-801e-1ee8b91255b0" returned: 0 in 1.052s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-a05535a0-bdf1-4148-801e-1ee8b91255b0" released by "_delete_snapshot" :: held 4.155s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-b6ca0777-4a26-4b5b-89ad-8362b44435e8" released by "delete_snapshot" :: held 4.220s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Created reservations ['a558fcce-46cb-4cab-9e42-2c65cefe8603', '24099bef-d6ce-4a5d-b59d-2a73658da470', 'ec527616-03a6-46c9-9a8e-416be2193aa4', '929f23ca-3fa9-4204-9215-ae281487b232'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Delete snapshot completed successfully. Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-032d673a-7bd1-4f57-8e7f-a00ec45ca473 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-a05535a0-bdf1-4148-801e-1ee8b91255b0-delete_snapshot" released by "delete_snapshot" :: held 4.388s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-98066100-0d1a-449d-bedd-90b935c2a496-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:04 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c" returned: 0 in 0.916s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105b0825-c0ca-4edb-a5ba-f831b0f6bbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d46f14-d644-4173-8ec1-82161cda301c', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:04 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958288c5-69f2-45e7-a0b4-4bc750c3df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-98066100-0d1a-449d-bedd-90b935c2a496-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.881s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:04 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Volume volume-35d46f14-d644-4173-8ec1-82161cda301c (35d46f14-d644-4173-8ec1-82161cda301c): created successfully Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958288c5-69f2-45e7-a0b4-4bc750c3df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Flow 'volume_create_manager' (d40ff227-6895-4ba9-b9ce-f6e522d7f2fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Deleted volume successfully. Jul 07 18:24:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5703bca8-a6d7-474f-90da-f35e1ff84bc5 tempest-CinderUnicodeTest-1351033245 None] Created volume successfully. Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-quobyte-98066100-0d1a-449d-bedd-90b935c2a496" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-309c8e7a-78ce-4d4a-bb9b-df453bea8896 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-9814f1c4-e4fe-40ac-b605-c77c5c10214b-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-98066100-0d1a-449d-bedd-90b935c2a496" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f106d63b-5212-4fdd-8a1f-15b3d3958b03]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:04 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496 Jul 07 18:24:04 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-b6ca0777-4a26-4b5b-89ad-8362b44435e8-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Lock "cinder-b6ca0777-4a26-4b5b-89ad-8362b44435e8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-b6ca0777-4a26-4b5b-89ad-8362b44435e8" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-b6ca0777-4a26-4b5b-89ad-8362b44435e8" acquired by "delete_volume" :: waited 0.049s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[97819fa0-6672-492b-9b69-18a37fd4ec08]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Creating offline snapshot 0c07dca8-da8f-4011-8884-4618e227833c of volume 35d46f14-d644-4173-8ec1-82161cda301c {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:24:05 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 Jul 07 18:24:05 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e478eef-4814-4d0d-8845-dde1854416a0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:05 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496" returned: 0 in 1.031s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:05 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496 Jul 07 18:24:05 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:05 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c Jul 07 18:24:05 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:06 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8" returned: 0 in 1.117s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:06 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-98066100-0d1a-449d-bedd-90b935c2a496" returned: 0 in 0.863s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:06 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8 Jul 07 18:24:06 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-98066100-0d1a-449d-bedd-90b935c2a496" released by "delete_volume" :: held 1.951s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:06 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c" returned: 0 in 0.937s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:06 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c 1G Jul 07 18:24:06 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created reservations ['4c4efc5c-bf9e-4266-93b8-4a4d0077c3cb', '90f0e71c-4895-4be9-b9b4-6f4f3601c4d6', '6075c61f-c2e0-45ac-8e20-ca1c424eda2d', '38b510d0-e60c-4308-b5f5-21fc9ce98742'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:06 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:06 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:07 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b6ca0777-4a26-4b5b-89ad-8362b44435e8" returned: 0 in 0.790s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-b6ca0777-4a26-4b5b-89ad-8362b44435e8" released by "delete_volume" :: held 2.004s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Created reservations ['b592ce22-ed7e-4df4-910d-77b42c855a24', '4a4c3583-2aad-45b3-b2e6-212b1b84f965', '20cb3817-1ff9-4741-9000-3d11ad2b5911', '267681da-2827-4a10-9b65-135a164813f4'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:07 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:07 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:07 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.786s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:07 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Deleted volume successfully. Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cec355cc-2f67-427b-82a8-26ab6cb851cc tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-98066100-0d1a-449d-bedd-90b935c2a496-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:07 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c 1G" returned: 0 in 1.092s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d46f14-d644-4173-8ec1-82161cda301c -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:07 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d46f14-d644-4173-8ec1-82161cda301c -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c Jul 07 18:24:07 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:07 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-a8898f19-b2e6-4395-886f-7aef8f1bcba9-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-a8898f19-b2e6-4395-886f-7aef8f1bcba9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "cinder-quobyte-a8898f19-b2e6-4395-886f-7aef8f1bcba9" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-a8898f19-b2e6-4395-886f-7aef8f1bcba9" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec03acd0-aced-4c2a-9842-a51f2981e9bc]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:08 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 Jul 07 18:24:08 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:08 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.840s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Deleted volume successfully. Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-fcbcbbce-024a-4906-9a31-c13e383ae20e tempest-ProjectReaderTests-1911194062 None] Lock "cinder-b6ca0777-4a26-4b5b-89ad-8362b44435e8-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:08 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d46f14-d644-4173-8ec1-82161cda301c -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c" returned: 0 in 0.850s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:08 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c is being set with open permissions: ugo+rw Jul 07 18:24:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:08 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c Jul 07 18:24:08 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:09 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9" returned: 0 in 0.952s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:09 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9 Jul 07 18:24:09 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (e8a346c9-f0ae-438a-9e22-98ec3648d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3755c545-529c-4f06-a657-3d55074377f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3755c545-529c-4f06-a657-3d55074377f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121751825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23397fc0-efc6-4f39-99d6-f24cbb9ca1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:09Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab3a05d-ccbd-4e90-8cff-d79e40f8c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab3a05d-ccbd-4e90-8cff-d79e40f8c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9f73aa-6b09-4d7c-8f30-2a8a9cb6c61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9f73aa-6b09-4d7c-8f30-2a8a9cb6c61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23397fc0-efc6-4f39-99d6-f24cbb9ca1ea', 'volume_name': 'volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f05b3f9-d6e0-4b5d-b81c-9a83d6051337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f05b3f9-d6e0-4b5d-b81c-9a83d6051337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1f7b06-660d-4cd3-b541-3af103ec4190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:09 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Volume 23397fc0-efc6-4f39-99d6-f24cbb9ca1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea', 'volume_size': 1} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:09 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c" returned: 0 in 0.966s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:09 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.info Jul 07 18:24:09 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:09 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-a8898f19-b2e6-4395-886f-7aef8f1bcba9" returned: 0 in 0.812s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-quobyte-a8898f19-b2e6-4395-886f-7aef8f1bcba9" released by "delete_volume" :: held 1.801s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Created reservations ['3f88d171-c3e0-4b5b-a425-efcc9cd83eea', 'fbdcdc83-5cd8-4bfd-ac9d-e796b4626af1', 'e24f34bd-311a-47e6-9b92-a7a915110b0b', 'e734b524-8cc4-4cff-bb87-5ca3ebc26d71'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:10 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:10 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:10 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.info" returned: 0 in 0.734s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:10 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.info is being set with open permissions: ugo+rw Jul 07 18:24:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:10 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.info Jul 07 18:24:10 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:10 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.743s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:10 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:10 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Deleted volume successfully. Jul 07 18:24:10 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-863afe39-91da-4341-a898-af79233c5d80 tempest-CreateVolumesFromSourceVolumeTest-1613448751 None] Lock "cinder-a8898f19-b2e6-4395-886f-7aef8f1bcba9-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:11 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.info" returned: 0 in 0.816s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.536s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121751825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23397fc0-efc6-4f39-99d6-f24cbb9ca1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:09Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Creating volume 23397fc0-efc6-4f39-99d6-f24cbb9ca1ea {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:24:11 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:24:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:11 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea 1073741824 Jul 07 18:24:11 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b5007950-b9e4-47e6-b578-5c33d2da492b tempest-CinderUnicodeTest-1351033245 None] Create snapshot completed successfully Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "cinder-0c07dca8-da8f-4011-8884-4618e227833c-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-0c07dca8-da8f-4011-8884-4618e227833c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "cinder-quobyte-35d46f14-d644-4173-8ec1-82161cda301c" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-quobyte-35d46f14-d644-4173-8ec1-82161cda301c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "cinder-quobyte-0c07dca8-da8f-4011-8884-4618e227833c" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-quobyte-0c07dca8-da8f-4011-8884-4618e227833c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Deleting offline snapshot 0c07dca8-da8f-4011-8884-4618e227833c of volume 35d46f14-d644-4173-8ec1-82161cda301c {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] snapshot_file for this snap is: volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3134ceff-a19c-4a46-b6b4-3a9706008715]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:12 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea 1073741824" returned: 0 in 1.033s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:12 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c Jul 07 18:24:12 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:12 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea Jul 07 18:24:12 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:12 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:12 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:13 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" returned: 0 in 0.884s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1f7b06-660d-4cd3-b541-3af103ec4190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf83161-dd29-45c9-a6a6-3841a3d401ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:13 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c" returned: 0 in 1.048s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d46f14-d644-4173-8ec1-82161cda301c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:24:13 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Volume volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea (23397fc0-efc6-4f39-99d6-f24cbb9ca1ea): created successfully Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf83161-dd29-45c9-a6a6-3841a3d401ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (e8a346c9-f0ae-438a-9e22-98ec3648d251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[f166f475-f31f-4ee4-bf89-7df354cac89e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-578ba468-4cec-45ad-9126-dad87b9943a5 tempest-ProjectReaderTests-1911194062 None] Created volume successfully. Jul 07 18:24:13 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c Jul 07 18:24:13 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Creating offline snapshot 9eb69f1e-52b8-46a1-83ce-0666b24d1d8b of volume 23397fc0-efc6-4f39-99d6-f24cbb9ca1ea {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f4640f-1649-4b6e-9ebc-056986c635c6]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:13 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.055s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:24:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:24:13 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea Jul 07 18:24:13 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:14 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c" returned: 0 in 1.103s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:14 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c Jul 07 18:24:14 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:14 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" returned: 0 in 1.066s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:14 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b 1G Jul 07 18:24:14 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:15 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c" returned: 0 in 1.029s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:15 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c Jul 07 18:24:15 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:16 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b 1G" returned: 0 in 1.127s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:16 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b Jul 07 18:24:16 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:16 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c.0c07dca8-da8f-4011-8884-4618e227833c" returned: 0 in 0.761s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-quobyte-0c07dca8-da8f-4011-8884-4618e227833c" released by "_delete_snapshot" :: held 4.121s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-quobyte-35d46f14-d644-4173-8ec1-82161cda301c" released by "delete_snapshot" :: held 4.151s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:16 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Created reservations ['0396ab2a-8621-4e05-ab93-df7a2f95e872', '3f605dee-af40-4762-bd43-66d075e40cf2', '6edd09a5-2d4e-41f0-b7f2-15f63e210a69', '1479d465-54ad-4da6-962d-52ba496f13f8'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:16 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Delete snapshot completed successfully. Jul 07 18:24:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c942650e-2785-4568-95e9-bdc7d8a691e7 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-0c07dca8-da8f-4011-8884-4618e227833c-delete_snapshot" released by "delete_snapshot" :: held 4.359s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:16 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b" returned: 0 in 0.829s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:16 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b is being set with open permissions: ugo+rw Jul 07 18:24:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:16 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b Jul 07 18:24:16 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "cinder-35d46f14-d644-4173-8ec1-82161cda301c-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-35d46f14-d644-4173-8ec1-82161cda301c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "cinder-quobyte-35d46f14-d644-4173-8ec1-82161cda301c" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:17 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-quobyte-35d46f14-d644-4173-8ec1-82161cda301c" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:17 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[454578c2-c5ca-409e-88b3-38270c6073b1]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:17 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b" returned: 0 in 0.843s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:17 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c Jul 07 18:24:17 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:17 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.info Jul 07 18:24:17 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:18 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.info" returned: 0 in 0.851s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:18 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.info is being set with open permissions: ugo+rw Jul 07 18:24:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:18 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.info Jul 07 18:24:18 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:18 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c" returned: 0 in 1.084s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:18 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c Jul 07 18:24:18 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:19 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.info" returned: 0 in 0.735s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.580s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0461d29e-3a07-4f13-ac9a-9b3b0dcf5547 tempest-ProjectReaderTests-1911194062 None] Create snapshot completed successfully Jul 07 18:24:19 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-35d46f14-d644-4173-8ec1-82161cda301c" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-quobyte-35d46f14-d644-4173-8ec1-82161cda301c" released by "delete_volume" :: held 1.968s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Created reservations ['fc8f7c51-1c29-4742-8fa7-8c9b619811ad', 'aa08fd94-4835-4d5b-925c-a74766766fdd', '9ac36330-da01-48dd-a018-8f6def15bce0', '23f25af8-fd8c-4897-8fa1-b6c71d9e8961'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:19 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:19 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "cinder-3613f176-60a8-4d41-82ef-5c9f5d1c90a2-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-3613f176-60a8-4d41-82ef-5c9f5d1c90a2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "cinder-quobyte-3613f176-60a8-4d41-82ef-5c9f5d1c90a2" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-quobyte-3613f176-60a8-4d41-82ef-5c9f5d1c90a2" acquired by "delete_volume" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9107ae08-126d-49d2-86d0-ad819ea93daa]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:20 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 Jul 07 18:24:20 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-9eb69f1e-52b8-46a1-83ce-0666b24d1d8b-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Lock "cinder-9eb69f1e-52b8-46a1-83ce-0666b24d1d8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-9eb69f1e-52b8-46a1-83ce-0666b24d1d8b" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-9eb69f1e-52b8-46a1-83ce-0666b24d1d8b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Deleting offline snapshot 9eb69f1e-52b8-46a1-83ce-0666b24d1d8b of volume 23397fc0-efc6-4f39-99d6-f24cbb9ca1ea {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] snapshot_file for this snap is: volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[16513a3e-b33f-4cde-b065-d3b13c9d7a40]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:20 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b Jul 07 18:24:20 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:20 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 1.108s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Deleted volume successfully. Jul 07 18:24:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f92e6308-2807-4ec4-8c80-99617a4ba354 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-35d46f14-d644-4173-8ec1-82161cda301c-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:21 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2" returned: 0 in 1.226s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:21 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2 Jul 07 18:24:21 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:21 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b" returned: 0 in 1.053s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:24:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ce765d-2157-488a-9c0f-3f7560d9bee2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:21 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea Jul 07 18:24:21 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:21 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-3613f176-60a8-4d41-82ef-5c9f5d1c90a2" returned: 0 in 0.727s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:21 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-quobyte-3613f176-60a8-4d41-82ef-5c9f5d1c90a2" released by "delete_volume" :: held 2.006s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:21 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Created reservations ['f9ac993f-1ae9-411f-8326-bd7d1c33f45d', '0717fdc8-ad9b-442b-a3f6-9a4ee80489cd', '37739cd7-c5b7-4948-ba56-e8384976e055', '8a369a59-19b4-4c98-ad8d-19ee3bc090d0'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:22 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:22 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:22 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" returned: 0 in 0.866s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:22 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b Jul 07 18:24:22 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:22 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.703s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:22 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Deleted volume successfully. Jul 07 18:24:22 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-2e16ab83-c2a3-47ee-8f35-468e09707cc1 tempest-CinderUnicodeTest-1351033245 None] Lock "cinder-3613f176-60a8-4d41-82ef-5c9f5d1c90a2-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:23 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b" returned: 0 in 0.768s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:23 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b Jul 07 18:24:23 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:23 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea.9eb69f1e-52b8-46a1-83ce-0666b24d1d8b" returned: 0 in 0.731s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-9eb69f1e-52b8-46a1-83ce-0666b24d1d8b" released by "_delete_snapshot" :: held 3.549s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" released by "delete_snapshot" :: held 3.592s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:24 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Created reservations ['0bec7524-7ef8-4ea8-bf8d-8167d1bf630b', '2323117c-4ab6-47c2-a230-3130720a9c11', 'b2913641-1a3e-45ae-9235-f10a1ff3a0a4', '561294f4-1fdd-4efa-b976-cf3ae6242c7a'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Delete snapshot completed successfully. Jul 07 18:24:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-7c296d61-be52-46d0-9e44-8ea2cc46e86b tempest-ProjectReaderTests-1911194062 None] Lock "cinder-9eb69f1e-52b8-46a1-83ce-0666b24d1d8b-delete_snapshot" released by "delete_snapshot" :: held 3.775s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[625429d6-c634-42e1-bab0-6da2f7831bfc]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:24 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea Jul 07 18:24:24 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:25 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" returned: 0 in 0.831s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:25 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea Jul 07 18:24:25 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:26 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" returned: 0 in 0.712s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea" released by "delete_volume" :: held 1.615s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:26 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Created reservations ['800a8615-b799-4675-a010-f8b1245192a5', '643b2cc7-9889-49bd-b23d-58f2def66d18', 'f995a47e-6372-4de7-8e6f-e3aa5a7b32c2', '96cf4af7-5726-460e-803e-8b687a838e12'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:26 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:26 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:27 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.708s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Deleted volume successfully. Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a99e917e-3f2b-4810-bc4b-fd864e1077f1 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-23397fc0-efc6-4f39-99d6-f24cbb9ca1ea-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (661362e1-dfda-40f5-9aad-7502913ee029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2019ac5-5d81-4d0a-b34d-0df90ac69afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2019ac5-5d81-4d0a-b34d-0df90ac69afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711130471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7a4301-2c04-4b1c-99e7-8712549062b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:27Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99bd90c-39ea-4cca-a44a-5c27b835da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99bd90c-39ea-4cca-a44a-5c27b835da95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3858e09d-9d22-4670-bc1f-6e0d855715ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3858e09d-9d22-4670-bc1f-6e0d855715ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7a4301-2c04-4b1c-99e7-8712549062b9', 'volume_name': 'volume-ed7a4301-2c04-4b1c-99e7-8712549062b9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ddf483-6ccd-4a70-8643-3c709a4652c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ddf483-6ccd-4a70-8643-3c709a4652c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99684121-1167-4c4a-91ca-485fe53467c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Volume ed7a4301-2c04-4b1c-99e7-8712549062b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7a4301-2c04-4b1c-99e7-8712549062b9', 'volume_size': 1} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1711130471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7a4301-2c04-4b1c-99e7-8712549062b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:27Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Creating volume ed7a4301-2c04-4b1c-99e7-8712549062b9 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:24:27 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:24:27 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 1073741824 Jul 07 18:24:27 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (c4e76940-26c4-4339-b263-701f7ecb3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137d9c7f-d3c8-4452-8534-0abf84c6e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137d9c7f-d3c8-4452-8534-0abf84c6e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96078081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96954249-b618-4de8-b494-482ef80069f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:28Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3c01e0-2ac3-45ab-a5a9-2eeca0971852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3c01e0-2ac3-45ab-a5a9-2eeca0971852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7506c8c2-7240-4d00-ae41-e228c64f4c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7506c8c2-7240-4d00-ae41-e228c64f4c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96954249-b618-4de8-b494-482ef80069f8', 'volume_name': 'volume-96954249-b618-4de8-b494-482ef80069f8', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f26d8f-5a0e-4b3f-a673-943c5851dbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f26d8f-5a0e-4b3f-a673-943c5851dbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a049d84-c637-49f4-a6be-f914c4086bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:27 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Volume 96954249-b618-4de8-b494-482ef80069f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96954249-b618-4de8-b494-482ef80069f8', 'volume_size': 1} Jul 07 18:24:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:28 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 1073741824" returned: 0 in 0.902s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:28 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 Jul 07 18:24:28 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:29 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9" returned: 0 in 0.649s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96078081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96954249-b618-4de8-b494-482ef80069f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:28Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Creating volume 96954249-b618-4de8-b494-482ef80069f8 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:24:29 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99684121-1167-4c4a-91ca-485fe53467c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7a4301-2c04-4b1c-99e7-8712549062b9', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:29 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 1073741824 Jul 07 18:24:29 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cbfb62-4a45-4d0f-8415-f00636d9b820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:29 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Volume volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 (ed7a4301-2c04-4b1c-99e7-8712549062b9): created successfully Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cbfb62-4a45-4d0f-8415-f00636d9b820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (661362e1-dfda-40f5-9aad-7502913ee029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:29 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-53c269eb-f5e4-4d65-8ce8-b1a8da9c8ee6 tempest-ProjectMemberTests-1897237629 None] Created volume successfully. Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:30 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 1073741824" returned: 0 in 1.003s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:30 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 Jul 07 18:24:30 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:30 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8" returned: 0 in 0.670s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.906s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Creating offline snapshot 84fd43c7-3c32-4478-86c8-560aa813afd8 of volume ed7a4301-2c04-4b1c-99e7-8712549062b9 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a049d84-c637-49f4-a6be-f914c4086bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96954249-b618-4de8-b494-482ef80069f8', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d2788e-14d6-4c52-998e-b4280cfe2bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5381ffa-a286-42af-8106-3f24ecc8dd33]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:30 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Volume volume-96954249-b618-4de8-b494-482ef80069f8 (96954249-b618-4de8-b494-482ef80069f8): created successfully Jul 07 18:24:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d2788e-14d6-4c52-998e-b4280cfe2bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:31 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (c4e76940-26c4-4339-b263-701f7ecb3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:31 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-03d734d4-51a5-47b7-abfd-16a08831b61e tempest-ProjectReaderTests-1911194062 None] Created volume successfully. Jul 07 18:24:31 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 Jul 07 18:24:31 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:31 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9" returned: 0 in 0.803s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:31 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 1G Jul 07 18:24:31 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:32 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 1G" returned: 0 in 0.826s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:32 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 Jul 07 18:24:32 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:33 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8" returned: 0 in 0.668s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:33 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 is being set with open permissions: ugo+rw Jul 07 18:24:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:33 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 Jul 07 18:24:33 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:33 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8" returned: 0 in 0.678s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:34 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.info Jul 07 18:24:34 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:34 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.info" returned: 0 in 0.699s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:34 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.info is being set with open permissions: ugo+rw Jul 07 18:24:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:34 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.info Jul 07 18:24:34 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:35 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.info" returned: 0 in 0.738s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.506s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.571s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Creating offline snapshot f7614c3f-c58d-4495-8c91-646b6c0ba788 of volume 96954249-b618-4de8-b494-482ef80069f8 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:24:35 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2ac46376-585b-4b66-b85f-9044b654db20 tempest-ProjectMemberTests-1897237629 None] Create snapshot completed successfully Jul 07 18:24:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3c14d5-6f50-498c-95f0-58ad9c5d292e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:35 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 Jul 07 18:24:35 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-84fd43c7-3c32-4478-86c8-560aa813afd8-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-84fd43c7-3c32-4478-86c8-560aa813afd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-ed7a4301-2c04-4b1c-99e7-8712549062b9" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-ed7a4301-2c04-4b1c-99e7-8712549062b9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-84fd43c7-3c32-4478-86c8-560aa813afd8" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-84fd43c7-3c32-4478-86c8-560aa813afd8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:36 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Deleting offline snapshot 84fd43c7-3c32-4478-86c8-560aa813afd8 of volume ed7a4301-2c04-4b1c-99e7-8712549062b9 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] snapshot_file for this snap is: volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8" returned: 0 in 0.852s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8c46f2-9226-4754-824f-7338f1533e1a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:36 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 1G Jul 07 18:24:36 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:36 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 Jul 07 18:24:36 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:37 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8" returned: 0 in 0.791s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7a4301-2c04-4b1c-99e7-8712549062b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c8bf19-da71-42c8-bb9c-31237a2c48a5]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:37 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 1G" returned: 0 in 0.855s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96954249-b618-4de8-b494-482ef80069f8 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:37 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96954249-b618-4de8-b494-482ef80069f8 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 Jul 07 18:24:37 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:37 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 Jul 07 18:24:37 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:37 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96954249-b618-4de8-b494-482ef80069f8 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788" returned: 0 in 0.762s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:37 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 is being set with open permissions: ugo+rw Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:37 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9" returned: 0 in 0.801s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:37 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 Jul 07 18:24:37 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:38 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 Jul 07 18:24:38 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:38 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788" returned: 0 in 0.778s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:38 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8" returned: 0 in 0.816s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:38 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.info Jul 07 18:24:38 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:38 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8 Jul 07 18:24:38 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:39 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.info" returned: 0 in 0.661s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:39 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.info is being set with open permissions: ugo+rw Jul 07 18:24:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:39 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.info Jul 07 18:24:39 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:39 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9.84fd43c7-3c32-4478-86c8-560aa813afd8" returned: 0 in 0.774s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-84fd43c7-3c32-4478-86c8-560aa813afd8" released by "_delete_snapshot" :: held 3.306s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-ed7a4301-2c04-4b1c-99e7-8712549062b9" released by "delete_snapshot" :: held 3.330s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:39 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Created reservations ['1c3da457-e7d8-4193-a148-4e7ef99084b7', '6d9f10c2-8c62-431f-b381-976a71a69444', '7fd01f10-ea77-4ccf-af87-a10d2ccc1bcf', 'c4deb028-0e19-48e7-9241-7ff16dfa233b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:39 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Delete snapshot completed successfully. Jul 07 18:24:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-10fd234c-0b02-4b25-a4db-e50ec1980280 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-84fd43c7-3c32-4478-86c8-560aa813afd8-delete_snapshot" released by "delete_snapshot" :: held 3.490s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:40 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.info" returned: 0 in 0.724s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.736s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:40 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c1eff5a8-3fa4-4a1e-a66d-909075838ee7 tempest-ProjectReaderTests-1911194062 None] Create snapshot completed successfully Jul 07 18:24:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-ed7a4301-2c04-4b1c-99e7-8712549062b9-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Lock "cinder-ed7a4301-2c04-4b1c-99e7-8712549062b9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-ed7a4301-2c04-4b1c-99e7-8712549062b9" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-ed7a4301-2c04-4b1c-99e7-8712549062b9" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:40 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa12862a-2b7f-4ce4-b11f-90e432f82540]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:40 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 Jul 07 18:24:40 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-f7614c3f-c58d-4495-8c91-646b6c0ba788-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Lock "cinder-f7614c3f-c58d-4495-8c91-646b6c0ba788-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-96954249-b618-4de8-b494-482ef80069f8" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-96954249-b618-4de8-b494-482ef80069f8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-f7614c3f-c58d-4495-8c91-646b6c0ba788" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-f7614c3f-c58d-4495-8c91-646b6c0ba788" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Deleting offline snapshot f7614c3f-c58d-4495-8c91-646b6c0ba788 of volume 96954249-b618-4de8-b494-482ef80069f8 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] snapshot_file for this snap is: volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec50bb9-37b9-4b92-b8ba-5a0eba4da4bf]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:41 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9" returned: 0 in 0.804s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:41 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9 Jul 07 18:24:41 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:41 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 Jul 07 18:24:41 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:42 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:42 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ed7a4301-2c04-4b1c-99e7-8712549062b9" returned: 0 in 0.710s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788" returned: 0 in 0.795s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96954249-b618-4de8-b494-482ef80069f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-ed7a4301-2c04-4b1c-99e7-8712549062b9" released by "delete_volume" :: held 1.584s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:INSERT=48,cinder:UPDATE=169,cinder:SELECT=121,cinder:DELETE=13 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[34644a86-5f4e-4672-8b12-188954599403]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Created reservations ['08cea979-ac93-47c6-8930-a5efc6944c65', 'bc878efe-91b6-4217-9df6-0c34b184a730', 'a3835240-7f90-4da0-85c8-cd336cd31373', '0de793a1-cb30-45e4-81f6-807ca850de36'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:42 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 Jul 07 18:24:42 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:42 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:42 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:43 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.703s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:43 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Deleted volume successfully. Jul 07 18:24:43 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8" returned: 0 in 0.899s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-61470caa-5c3b-40a4-b188-431fd267bc9d tempest-ProjectMemberTests-1897237629 None] Lock "cinder-ed7a4301-2c04-4b1c-99e7-8712549062b9-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:43 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 Jul 07 18:24:43 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (bcb1218d-18cb-4db7-a637-cbd2da7dc2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ec5e27-bac0-4f93-bf48-69fc70d09229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ec5e27-bac0-4f93-bf48-69fc70d09229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657195323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad972066-540d-444c-b0c5-8a1c7a1fb8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:43Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c72c75-7139-43de-ae1b-4fc8a7e75c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7c72c75-7139-43de-ae1b-4fc8a7e75c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec587bbc-285d-4106-9568-8f17de2d273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec587bbc-285d-4106-9568-8f17de2d273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad972066-540d-444c-b0c5-8a1c7a1fb8a5', 'volume_name': 'volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af76a344-0862-4e4b-85ef-c41e4fd3930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af76a344-0862-4e4b-85ef-c41e4fd3930b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5148d1ce-4f59-4c99-adb9-1eacb1686618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:43 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Volume ad972066-540d-444c-b0c5-8a1c7a1fb8a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5', 'volume_size': 1} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657195323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad972066-540d-444c-b0c5-8a1c7a1fb8a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:43Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Creating volume ad972066-540d-444c-b0c5-8a1c7a1fb8a5 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:24:43 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:43 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 1073741824 Jul 07 18:24:43 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:43 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788" returned: 0 in 0.861s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:43 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788 Jul 07 18:24:43 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:44 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 1073741824" returned: 0 in 0.894s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:44 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 Jul 07 18:24:44 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:44 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8.f7614c3f-c58d-4495-8c91-646b6c0ba788" returned: 0 in 0.748s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-f7614c3f-c58d-4495-8c91-646b6c0ba788" released by "_delete_snapshot" :: held 3.414s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-96954249-b618-4de8-b494-482ef80069f8" released by "delete_snapshot" :: held 3.437s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:44 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Created reservations ['686e3050-64f0-4026-a179-efe421237fdd', '4082bf96-49b6-452e-92d4-285a4249e7e0', '077a4825-009a-4d27-93b7-220c40fc4903', '9a2c32c3-bbb4-4a8d-bc24-dad43267e7ea'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Delete snapshot completed successfully. Jul 07 18:24:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-04b9961d-9d7d-4715-85c3-87390ca6732a tempest-ProjectReaderTests-1911194062 None] Lock "cinder-f7614c3f-c58d-4495-8c91-646b6c0ba788-delete_snapshot" released by "delete_snapshot" :: held 3.594s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:45 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" returned: 0 in 0.757s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5148d1ce-4f59-4c99-adb9-1eacb1686618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1639c13b-de7b-4e85-b79d-9d423b07157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:45 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Volume volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 (ad972066-540d-444c-b0c5-8a1c7a1fb8a5): created successfully Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1639c13b-de7b-4e85-b79d-9d423b07157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (bcb1218d-18cb-4db7-a637-cbd2da7dc2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:45 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-293ede3f-6ea5-479e-998f-ad4770f10bda tempest-ProjectMemberTests-1897237629 None] Created volume successfully. Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-96954249-b618-4de8-b494-482ef80069f8-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-96954249-b618-4de8-b494-482ef80069f8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Creating offline snapshot 2d830da5-e3a6-4d44-a394-87086d680d07 of volume ad972066-540d-444c-b0c5-8a1c7a1fb8a5 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad82d62d-ae21-4904-ab46-7e95caa7b8d5]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-96954249-b618-4de8-b494-482ef80069f8" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-96954249-b618-4de8-b494-482ef80069f8" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db5b9cf-b269-48ed-b595-99718dd9c56f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:45 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 Jul 07 18:24:45 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:45 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 Jul 07 18:24:45 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:46 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" returned: 0 in 0.773s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:46 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 1G Jul 07 18:24:46 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:46 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8" returned: 0 in 0.778s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:46 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8 Jul 07 18:24:46 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:47 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-96954249-b618-4de8-b494-482ef80069f8" returned: 0 in 0.686s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-96954249-b618-4de8-b494-482ef80069f8" released by "delete_volume" :: held 1.527s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Created reservations ['a4db3c5e-02a3-4e48-bd29-96edb05795f3', '38dbbda5-53da-423a-95c9-60f4420a354c', '70a529df-ba36-442d-9a1b-05e396270877', 'fbac4235-f420-4342-9497-1f06e22f711e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:47 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 1G" returned: 0 in 0.858s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:47 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 Jul 07 18:24:47 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:47 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:47 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:48 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07" returned: 0 in 0.724s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:48 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 is being set with open permissions: ugo+rw Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:48 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 Jul 07 18:24:48 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:48 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.746s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:48 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Deleted volume successfully. Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-37837892-889c-45db-80e8-673a78644064 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-96954249-b618-4de8-b494-482ef80069f8-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (8ec3efd2-2ce3-4827-8b28-0205acb71033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b025841b-4b5e-4086-8548-b5d25f2f98a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b025841b-4b5e-4086-8548-b5d25f2f98a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846829214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de34340c-9b63-4243-a51e-4b08b2e335f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:48Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdfe347-f33f-44d2-a1e3-e44ad5c9349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebdfe347-f33f-44d2-a1e3-e44ad5c9349e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de010684-daba-410c-ae73-cb9158c0728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de010684-daba-410c-ae73-cb9158c0728a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de34340c-9b63-4243-a51e-4b08b2e335f1', 'volume_name': 'volume-de34340c-9b63-4243-a51e-4b08b2e335f1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4832e1b3-1dc3-46cc-b56d-c7f9bcc7f1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4832e1b3-1dc3-46cc-b56d-c7f9bcc7f1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6623c7-006f-48e2-be66-12269da6f730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:48 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Volume de34340c-9b63-4243-a51e-4b08b2e335f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de34340c-9b63-4243-a51e-4b08b2e335f1', 'volume_size': 1} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:48 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:48 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.info Jul 07 18:24:48 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:49 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.info" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:49 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.info is being set with open permissions: ugo+rw Jul 07 18:24:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:49 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.info Jul 07 18:24:49 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:50 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.info" returned: 0 in 0.673s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.539s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.714s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-846829214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de34340c-9b63-4243-a51e-4b08b2e335f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:48Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Creating volume de34340c-9b63-4243-a51e-4b08b2e335f1 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:24:50 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:50 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 1073741824 Jul 07 18:24:50 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:50 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e2876110-64e1-488e-a75f-2f83ecc4a4ce tempest-ProjectMemberTests-1897237629 None] Create snapshot completed successfully Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-2d830da5-e3a6-4d44-a394-87086d680d07-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-2d830da5-e3a6-4d44-a394-87086d680d07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-2d830da5-e3a6-4d44-a394-87086d680d07" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-2d830da5-e3a6-4d44-a394-87086d680d07" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Deleting offline snapshot 2d830da5-e3a6-4d44-a394-87086d680d07 of volume ad972066-540d-444c-b0c5-8a1c7a1fb8a5 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] snapshot_file for this snap is: volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb43d01f-27dc-405b-acca-91fd3c30a106]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:51 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 Jul 07 18:24:51 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:51 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 1073741824" returned: 0 in 0.927s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=166,cinder:SELECT=130,cinder:DELETE=15,cinder:INSERT=43 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:51 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 Jul 07 18:24:51 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:51 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07" returned: 0 in 0.813s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[02393c5a-0ad4-4862-a3bb-e49db7b503f6]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:51 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1" returned: 0 in 0.680s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6623c7-006f-48e2-be66-12269da6f730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de34340c-9b63-4243-a51e-4b08b2e335f1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab414281-f479-4b01-8c12-c7572ff61ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:51 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Volume volume-de34340c-9b63-4243-a51e-4b08b2e335f1 (de34340c-9b63-4243-a51e-4b08b2e335f1): created successfully Jul 07 18:24:51 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 Jul 07 18:24:51 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab414281-f479-4b01-8c12-c7572ff61ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (8ec3efd2-2ce3-4827-8b28-0205acb71033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a1549d4c-22f9-4673-986d-7221a860b1d0 tempest-ProjectReaderTests-1911194062 None] Created volume successfully. Jul 07 18:24:52 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:52 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 Jul 07 18:24:52 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:52 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Creating offline snapshot 8f25d448-18f2-4873-a8eb-2b0862dbf784 of volume de34340c-9b63-4243-a51e-4b08b2e335f1 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:24:52 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d21c8-08b4-4e77-b8a5-bba263c5ff96]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:52 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 Jul 07 18:24:52 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:53 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07" returned: 0 in 0.773s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:53 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07 Jul 07 18:24:53 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:53 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:53 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 1G Jul 07 18:24:53 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:54 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5.2d830da5-e3a6-4d44-a394-87086d680d07" returned: 0 in 0.702s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-2d830da5-e3a6-4d44-a394-87086d680d07" released by "_delete_snapshot" :: held 3.199s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" released by "delete_snapshot" :: held 3.225s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:54 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Created reservations ['db649f21-10ef-40e7-b136-c8e56cef10f5', '3d021dea-8960-499c-9cef-77555a65b255', '2f3476d8-173a-476c-aabc-260d88ba028c', '09e34824-38d6-4e55-8d4c-94810d3ab616'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Delete snapshot completed successfully. Jul 07 18:24:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-f8edcbf3-499f-4d30-8a6a-87706eda6462 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-2d830da5-e3a6-4d44-a394-87086d680d07-delete_snapshot" released by "delete_snapshot" :: held 3.388s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:54 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 1G" returned: 0 in 0.883s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de34340c-9b63-4243-a51e-4b08b2e335f1 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:54 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de34340c-9b63-4243-a51e-4b08b2e335f1 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 Jul 07 18:24:54 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:55 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de34340c-9b63-4243-a51e-4b08b2e335f1 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784" returned: 0 in 0.704s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:55 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 is being set with open permissions: ugo+rw Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-ad972066-540d-444c-b0c5-8a1c7a1fb8a5-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:55 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 Jul 07 18:24:55 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-ad972066-540d-444c-b0c5-8a1c7a1fb8a5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" acquired by "delete_volume" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b0463d-6eb9-4cfb-92c6-b6f6e15492b2]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:55 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 Jul 07 18:24:55 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:55 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784" returned: 0 in 0.653s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:55 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.info Jul 07 18:24:55 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:56 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" returned: 0 in 0.794s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:56 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5 Jul 07 18:24:56 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:56 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.info" returned: 0 in 0.693s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:56 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.info is being set with open permissions: ugo+rw Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:56 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.info Jul 07 18:24:56 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:56 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" returned: 0 in 0.651s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-ad972066-540d-444c-b0c5-8a1c7a1fb8a5" released by "delete_volume" :: held 1.513s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Created reservations ['3f8d32f0-8399-4057-9098-9e0aec933a9d', '044cdb0c-8b02-4619-a303-ba31fbb14402', 'c87e4eed-9243-4a08-b421-fca66be0e954', '89be2fef-6d88-45fa-8724-e90e4eed6f4f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:56 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:24:56 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:57 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.info" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.449s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-454eda3f-65bc-4db1-a1b6-0ca9ead65a42 tempest-ProjectReaderTests-1911194062 None] Create snapshot completed successfully Jul 07 18:24:57 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.646s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:24:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Deleted volume successfully. Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-159ffb50-155b-4611-bc3c-a2bead3da349 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-ad972066-540d-444c-b0c5-8a1c7a1fb8a5-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (e898dadd-8e4d-43b4-abad-af24405f4bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d0c419-ebfb-4e44-acaf-001a53e2d68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d0c419-ebfb-4e44-acaf-001a53e2d68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863036376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad0dd00-0354-4caf-9ddb-eab083c556c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:58Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09821f2e-9429-4ed6-9372-492f87809551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09821f2e-9429-4ed6-9372-492f87809551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed6d0de-95ba-4012-babc-b81746c38f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed6d0de-95ba-4012-babc-b81746c38f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad0dd00-0354-4caf-9ddb-eab083c556c6', 'volume_name': 'volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd6d8b3-3bc0-4058-9117-45b502c8ab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd6d8b3-3bc0-4058-9117-45b502c8ab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f51b4f-8c67-415e-9336-4db8c85ef114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Volume 7ad0dd00-0354-4caf-9ddb-eab083c556c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6', 'volume_size': 1} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863036376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad0dd00-0354-4caf-9ddb-eab083c556c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:24:58Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Creating volume 7ad0dd00-0354-4caf-9ddb-eab083c556c6 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:24:57 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:57 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 1073741824 Jul 07 18:24:57 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-8f25d448-18f2-4873-a8eb-2b0862dbf784-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-8f25d448-18f2-4873-a8eb-2b0862dbf784-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-de34340c-9b63-4243-a51e-4b08b2e335f1" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-de34340c-9b63-4243-a51e-4b08b2e335f1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-8f25d448-18f2-4873-a8eb-2b0862dbf784" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-8f25d448-18f2-4873-a8eb-2b0862dbf784" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Deleting offline snapshot 8f25d448-18f2-4873-a8eb-2b0862dbf784 of volume de34340c-9b63-4243-a51e-4b08b2e335f1 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] snapshot_file for this snap is: volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a02970-9d60-4b2d-b4be-6317bc09caea]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:58 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 Jul 07 18:24:58 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:58 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 1073741824" returned: 0 in 0.856s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:58 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 Jul 07 18:24:58 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:58 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784" returned: 0 in 0.796s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de34340c-9b63-4243-a51e-4b08b2e335f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6b11eb-2465-480d-80aa-8091ced02752]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:24:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:58 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 Jul 07 18:24:58 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:59 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6" returned: 0 in 0.661s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72f51b4f-8c67-415e-9336-4db8c85ef114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a546e9-bb23-4939-8ec9-2e59da2b0013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:24:59 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Volume volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 (7ad0dd00-0354-4caf-9ddb-eab083c556c6): created successfully Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a546e9-bb23-4939-8ec9-2e59da2b0013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (e898dadd-8e4d-43b4-abad-af24405f4bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:24:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a4fbab4f-7062-42c2-b012-089143bcad1c tempest-ProjectMemberTests-1897237629 None] Created volume successfully. Jul 07 18:24:59 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1" returned: 0 in 0.759s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:24:59 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 Jul 07 18:24:59 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:24:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Creating offline snapshot 11ea474c-a4fd-437d-b1da-ba9305060061 of volume 7ad0dd00-0354-4caf-9ddb-eab083c556c6 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:25:00 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[a011a1fe-188e-46f4-969e-df91481cf480]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:00 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 Jul 07 18:25:00 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:00 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784" returned: 0 in 0.721s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:00 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784 Jul 07 18:25:00 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:00 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6" returned: 0 in 0.771s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:00 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 1G Jul 07 18:25:00 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:01 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1.8f25d448-18f2-4873-a8eb-2b0862dbf784" returned: 0 in 0.663s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:01 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-8f25d448-18f2-4873-a8eb-2b0862dbf784" released by "_delete_snapshot" :: held 3.033s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:01 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-de34340c-9b63-4243-a51e-4b08b2e335f1" released by "delete_snapshot" :: held 3.058s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:01 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Created reservations ['a1c3bf0f-39fe-48f2-8992-8b1ec858e02d', 'fd584d8e-9c6a-4e9f-82ca-b19015336728', '2226e391-882c-45bb-8dc7-f622d8178fbb', 'f69f4c41-3f29-445c-885c-6172708a611e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:01 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Delete snapshot completed successfully. Jul 07 18:25:01 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a78b3fc0-7725-4f90-b2ed-df40f960e0d5 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-8f25d448-18f2-4873-a8eb-2b0862dbf784-delete_snapshot" released by "delete_snapshot" :: held 3.208s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:01 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 1G" returned: 0 in 0.868s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:01 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 Jul 07 18:25:01 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-de34340c-9b63-4243-a51e-4b08b2e335f1-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Lock "cinder-de34340c-9b63-4243-a51e-4b08b2e335f1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-de34340c-9b63-4243-a51e-4b08b2e335f1" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:02 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-de34340c-9b63-4243-a51e-4b08b2e335f1" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:02 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf80a0ff-1e4e-4f42-bddb-b8f4d8248ca3]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:02 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061" returned: 0 in 0.739s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:02 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 is being set with open permissions: ugo+rw Jul 07 18:25:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:02 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 Jul 07 18:25:02 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:02 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 Jul 07 18:25:02 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:03 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061" returned: 0 in 0.655s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:03 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:03 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.info Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1" returned: 0 in 0.781s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:03 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:03 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1 Jul 07 18:25:03 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:03 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.info" returned: 0 in 0.694s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:03 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.info is being set with open permissions: ugo+rw Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:03 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.info Jul 07 18:25:03 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:03 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-de34340c-9b63-4243-a51e-4b08b2e335f1" returned: 0 in 0.701s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-de34340c-9b63-4243-a51e-4b08b2e335f1" released by "delete_volume" :: held 1.554s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Created reservations ['9312f6aa-f6c7-4c6b-b52e-097d27a2a312', 'cc0aa1f5-4d7d-4a23-83e5-a1a133c841b2', '6d500a35-098d-4dfb-a3eb-fe8fc83722f1', '0bc5ebf5-b9c1-45c3-891c-bf6c60eac89e'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:04 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:04 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:04 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.info" returned: 0 in 0.720s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.538s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-562c91fc-c9fd-4e11-b96f-85cccb7235af tempest-ProjectMemberTests-1897237629 None] Create snapshot completed successfully Jul 07 18:25:04 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.749s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:04 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:04 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Deleted volume successfully. Jul 07 18:25:04 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0048bc9b-69c5-49bf-8039-8f82aa8ec5fb tempest-ProjectReaderTests-1911194062 None] Lock "cinder-de34340c-9b63-4243-a51e-4b08b2e335f1-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:04 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (19ebc57e-4925-4127-9551-002bb5db7795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:04 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b47e1b3-7dd0-46d5-956d-c140ef8b4811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b47e1b3-7dd0-46d5-956d-c140ef8b4811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1142336196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c8a2cf-e6c3-40dc-a362-eee734b299e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:05Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c32c55-52c1-4568-99b2-4f40be5636a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c32c55-52c1-4568-99b2-4f40be5636a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1032a2c5-1524-4f97-a581-dd852cb20539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1032a2c5-1524-4f97-a581-dd852cb20539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c8a2cf-e6c3-40dc-a362-eee734b299e4', 'volume_name': 'volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3c9e45-fda5-45a1-b55b-b8a7ad20a278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3c9e45-fda5-45a1-b55b-b8a7ad20a278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c83a65-8247-4dd4-8457-bacea1e87c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:05 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Volume f7c8a2cf-e6c3-40dc-a362-eee734b299e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4', 'volume_size': 1} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1142336196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c8a2cf-e6c3-40dc-a362-eee734b299e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79ac276844b846b8ac1718cbe7bf19ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:05Z,use_quota=True,user_id='00acd466ffbd44a5851ab147613cfb5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Creating volume f7c8a2cf-e6c3-40dc-a362-eee734b299e4 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:05 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:05 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 1073741824 Jul 07 18:25:05 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-11ea474c-a4fd-437d-b1da-ba9305060061-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Lock "cinder-11ea474c-a4fd-437d-b1da-ba9305060061-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-7ad0dd00-0354-4caf-9ddb-eab083c556c6" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-7ad0dd00-0354-4caf-9ddb-eab083c556c6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-11ea474c-a4fd-437d-b1da-ba9305060061" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-11ea474c-a4fd-437d-b1da-ba9305060061" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Deleting offline snapshot 11ea474c-a4fd-437d-b1da-ba9305060061 of volume 7ad0dd00-0354-4caf-9ddb-eab083c556c6 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] snapshot_file for this snap is: volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5848a40-5a21-4563-8357-26ff1c130902]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:05 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 Jul 07 18:25:05 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:05 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 1073741824" returned: 0 in 0.853s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:05 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 Jul 07 18:25:05 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:06 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061" returned: 0 in 0.789s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[365c12a9-861b-4479-bed7-36bda1d150e4]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:06 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 Jul 07 18:25:06 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:06 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" returned: 0 in 0.703s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c83a65-8247-4dd4-8457-bacea1e87c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0afcc4-7728-47a9-ba78-dc792022a715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:06 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Volume volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 (f7c8a2cf-e6c3-40dc-a362-eee734b299e4): created successfully Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0afcc4-7728-47a9-ba78-dc792022a715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Flow 'volume_create_manager' (19ebc57e-4925-4127-9551-002bb5db7795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:06 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-20b3fa82-75a5-4622-bbd8-ad2d1bc6b2cd tempest-ProjectReaderTests-1911194062 None] Created volume successfully. Jul 07 18:25:06 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6" returned: 0 in 0.836s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:07 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 Jul 07 18:25:07 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:07 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Creating offline snapshot f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 of volume f7c8a2cf-e6c3-40dc-a362-eee734b299e4 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:25:07 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a50ab8f-8376-4bc6-8fef-df441d553267]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:07 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 Jul 07 18:25:07 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:07 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061" returned: 0 in 0.786s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:07 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061 Jul 07 18:25:07 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:08 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" returned: 0 in 0.761s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:08 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 1G Jul 07 18:25:08 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:08 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6.11ea474c-a4fd-437d-b1da-ba9305060061" returned: 0 in 0.737s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-11ea474c-a4fd-437d-b1da-ba9305060061" released by "_delete_snapshot" :: held 3.237s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-7ad0dd00-0354-4caf-9ddb-eab083c556c6" released by "delete_snapshot" :: held 3.258s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:08 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Created reservations ['506143ee-ed24-421a-8e0e-f6ee563e51e1', 'ad723750-8d39-4b28-bd69-6ed1187d88a2', '6b55ffb7-41d9-4fca-a47b-f8cd3ea5909c', '4373c248-604e-4190-8c42-4caaa8e1ff2f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Delete snapshot completed successfully. Jul 07 18:25:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e3b80ab0-2f8b-4fa4-9881-7df6043018bf tempest-ProjectMemberTests-1897237629 None] Lock "cinder-11ea474c-a4fd-437d-b1da-ba9305060061-delete_snapshot" released by "delete_snapshot" :: held 3.429s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:08 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 1G" returned: 0 in 0.904s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:08 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 Jul 07 18:25:08 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-7ad0dd00-0354-4caf-9ddb-eab083c556c6-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-7ad0dd00-0354-4caf-9ddb-eab083c556c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-7ad0dd00-0354-4caf-9ddb-eab083c556c6" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-7ad0dd00-0354-4caf-9ddb-eab083c556c6" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:09 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ea20c4-1f6a-4364-93d4-24e0043d9f38]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:09 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7" returned: 0 in 0.742s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:09 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 is being set with open permissions: ugo+rw Jul 07 18:25:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:09 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 Jul 07 18:25:09 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:09 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 Jul 07 18:25:09 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:10 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7" returned: 0 in 0.618s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:10 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.info Jul 07 18:25:10 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:10 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6" returned: 0 in 0.784s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:10 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6 Jul 07 18:25:10 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:10 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.info" returned: 0 in 0.668s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:10 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.info is being set with open permissions: ugo+rw Jul 07 18:25:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:11 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.info Jul 07 18:25:11 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:11 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7ad0dd00-0354-4caf-9ddb-eab083c556c6" returned: 0 in 0.658s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-7ad0dd00-0354-4caf-9ddb-eab083c556c6" released by "delete_volume" :: held 1.508s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Created reservations ['e00444cf-6c13-405e-b231-f68059511d8b', '4f83000d-cee9-4ad7-b8e7-b21128f73c5e', '51053feb-450e-42a4-86e2-41be44c979f5', 'fe52ad12-93c3-419a-ba03-cacaf4f58278'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:11 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:11 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:11 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.info" returned: 0 in 0.647s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.423s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-56fa6a02-05be-4b5c-be04-5bc635d0ae83 tempest-ProjectReaderTests-1911194062 None] Create snapshot completed successfully Jul 07 18:25:11 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.665s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:11 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Deleted volume successfully. Jul 07 18:25:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-c2a3e098-0c4c-447e-9e8c-b627d34ec789 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-7ad0dd00-0354-4caf-9ddb-eab083c556c6-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (1deffed1-88b2-401d-a107-ac7936a0484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4229e331-f551-4922-8998-ec7d9cd4da2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4229e331-f551-4922-8998-ec7d9cd4da2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990666287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3f42d0-7934-4485-9669-6a545c88495d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:12Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbcffdc-94df-4924-8593-56e732de372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbcffdc-94df-4924-8593-56e732de372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda64ac3-a6c6-4064-8914-f29afe57300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda64ac3-a6c6-4064-8914-f29afe57300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3f42d0-7934-4485-9669-6a545c88495d', 'volume_name': 'volume-fc3f42d0-7934-4485-9669-6a545c88495d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1829df-e4af-4645-b3a6-8cab92c5acf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1829df-e4af-4645-b3a6-8cab92c5acf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b736bf-f613-4a7b-8958-60c851951f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:12 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Volume fc3f42d0-7934-4485-9669-6a545c88495d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3f42d0-7934-4485-9669-6a545c88495d', 'volume_size': 1} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1990666287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3f42d0-7934-4485-9669-6a545c88495d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:12Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Creating volume fc3f42d0-7934-4485-9669-6a545c88495d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:12 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:12 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d 1073741824 Jul 07 18:25:12 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Deleting offline snapshot f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 of volume f7c8a2cf-e6c3-40dc-a362-eee734b299e4 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] snapshot_file for this snap is: volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[0386e710-deb8-4809-b7b5-5045f5abf1e6]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:12 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 Jul 07 18:25:12 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:12 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:12 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:13 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d 1073741824" returned: 0 in 0.888s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:13 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d Jul 07 18:25:13 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:13 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7" returned: 0 in 0.813s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[5681b0c9-ed53-4c83-82fc-b3a5e8edbd64]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:13 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 Jul 07 18:25:13 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:13 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.765s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:25:13 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d" returned: 0 in 0.663s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b736bf-f613-4a7b-8958-60c851951f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3f42d0-7934-4485-9669-6a545c88495d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781708f2-62cc-4392-9fde-bbc32cdb0885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:13 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Volume volume-fc3f42d0-7934-4485-9669-6a545c88495d (fc3f42d0-7934-4485-9669-6a545c88495d): created successfully Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781708f2-62cc-4392-9fde-bbc32cdb0885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (1deffed1-88b2-401d-a107-ac7936a0484c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:13 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-14f6c44a-9a40-495b-946d-fba721bc8dd8 tempest-ProjectMemberTests-1897237629 None] Created volume successfully. Jul 07 18:25:14 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" returned: 0 in 0.831s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:14 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 Jul 07 18:25:14 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Creating offline snapshot b055b9b6-a2cd-461e-b701-898a09898a32 of volume fc3f42d0-7934-4485-9669-6a545c88495d {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:25:14 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[2288350d-fc19-4e8d-a097-60d0ed78acba]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:14 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d Jul 07 18:25:14 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:15 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7" returned: 0 in 0.824s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:15 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7 Jul 07 18:25:15 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:15 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d" returned: 0 in 0.838s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:15 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 1G Jul 07 18:25:15 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:15 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4.f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7" returned: 0 in 0.697s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7" released by "_delete_snapshot" :: held 3.270s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" released by "delete_snapshot" :: held 3.293s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:15 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Created reservations ['efd0fbdb-f582-426f-ae20-944e42bcc4da', '0cdeee3f-3c36-4266-80c8-a434c4f97d6e', '95b0a783-3bf7-4386-9cb7-afaa3f1b1b93', '712e05c0-2beb-4c24-ba0d-06c2788bd539'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:15 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Delete snapshot completed successfully. Jul 07 18:25:15 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-92aaadb6-ae76-41f5-b40d-cc4f4ba61c13 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-f6d492ab-3fbb-4bb0-a11a-c1597f7d56b7-delete_snapshot" released by "delete_snapshot" :: held 3.450s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:16 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 1G" returned: 0 in 0.880s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc3f42d0-7934-4485-9669-6a545c88495d -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:16 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc3f42d0-7934-4485-9669-6a545c88495d -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 Jul 07 18:25:16 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-f7c8a2cf-e6c3-40dc-a362-eee734b299e4-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-f7c8a2cf-e6c3-40dc-a362-eee734b299e4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "cinder-quobyte-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:16 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:16 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5da7c85-ed1e-4917-b808-0ffaaa908831]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:16 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 Jul 07 18:25:16 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:17 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc3f42d0-7934-4485-9669-6a545c88495d -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32" returned: 0 in 0.789s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:17 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 is being set with open permissions: ugo+rw Jul 07 18:25:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:17 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 Jul 07 18:25:17 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:17 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" returned: 0 in 0.828s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:17 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4 Jul 07 18:25:17 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:17 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32" returned: 0 in 0.722s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:17 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.info Jul 07 18:25:17 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:18 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" returned: 0 in 0.684s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-quobyte-f7c8a2cf-e6c3-40dc-a362-eee734b299e4" released by "delete_volume" :: held 1.579s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Created reservations ['53f4c260-117a-43b3-8cce-02a670e6cee9', 'abef71ad-ee8b-445d-877c-c68207e8d0b7', '88c74ff5-6596-4e0d-9909-904914b3d81f', '6980de32-4f1c-4048-819b-931a59f6c391'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:18 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.info" returned: 0 in 0.725s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:18 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.info is being set with open permissions: ugo+rw Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:18 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.info Jul 07 18:25:18 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:18 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:18 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:19 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.info" returned: 0 in 0.708s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.767s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:19 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c90049c5-87b5-4f22-86c7-2007f5dbddcc tempest-ProjectMemberTests-1897237629 None] Create snapshot completed successfully Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.711s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Deleted volume successfully. Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a9bf985e-1bcf-415b-8ff0-5cf1be98de35 tempest-ProjectReaderTests-1911194062 None] Lock "cinder-f7c8a2cf-e6c3-40dc-a362-eee734b299e4-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-b055b9b6-a2cd-461e-b701-898a09898a32-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Lock "cinder-b055b9b6-a2cd-461e-b701-898a09898a32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-fc3f42d0-7934-4485-9669-6a545c88495d" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-fc3f42d0-7934-4485-9669-6a545c88495d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-b055b9b6-a2cd-461e-b701-898a09898a32" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-b055b9b6-a2cd-461e-b701-898a09898a32" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Deleting offline snapshot b055b9b6-a2cd-461e-b701-898a09898a32 of volume fc3f42d0-7934-4485-9669-6a545c88495d {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] snapshot_file for this snap is: volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a820103-c22c-47cd-88de-835a755cf4a8]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:19 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 Jul 07 18:25:19 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:20 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32" returned: 0 in 0.858s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc3f42d0-7934-4485-9669-6a545c88495d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:25:20 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa98fe6f-b229-4206-a36b-0bb0c68ea121]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:20 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d Jul 07 18:25:20 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:21 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d" returned: 0 in 0.801s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:21 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 Jul 07 18:25:21 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:22 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32" returned: 0 in 0.842s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:22 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32 Jul 07 18:25:22 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:23 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Flow 'volume_create_manager' (14b5a495-ffc6-4a8c-8714-5dffe86389a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b7ee56-e0c0-4bfb-a77f-edea8797f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d.b055b9b6-a2cd-461e-b701-898a09898a32" returned: 0 in 0.729s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b7ee56-e0c0-4bfb-a77f-edea8797f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11656755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2c4cb1-517a-4ad2-a28d-21a044833be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e9a8a0c58f4d2b9ff8c2d223de9c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:23Z,use_quota=True,user_id='7266bcd265dc4ee9bb95219a8cef3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6d538b-760f-4c57-b956-b8d24fc4585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6d538b-760f-4c57-b956-b8d24fc4585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddfac1c-c871-4b70-b444-a1b53eb4ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bddfac1c-c871-4b70-b444-a1b53eb4ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d2c4cb1-517a-4ad2-a28d-21a044833be1', 'volume_name': 'volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fbe71e-beee-41f6-83d5-86d8852da474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fbe71e-beee-41f6-83d5-86d8852da474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859ca370-6fab-4315-b663-f048175a4e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:23 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Volume 0d2c4cb1-517a-4ad2-a28d-21a044833be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1', 'volume_size': 1} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-11656755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d2c4cb1-517a-4ad2-a28d-21a044833be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e9a8a0c58f4d2b9ff8c2d223de9c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:23Z,use_quota=True,user_id='7266bcd265dc4ee9bb95219a8cef3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Creating volume 0d2c4cb1-517a-4ad2-a28d-21a044833be1 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:23 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-b055b9b6-a2cd-461e-b701-898a09898a32" released by "_delete_snapshot" :: held 3.405s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-fc3f42d0-7934-4485-9669-6a545c88495d" released by "delete_snapshot" :: held 3.434s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:23 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 1073741824 Jul 07 18:25:23 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Created reservations ['930a718f-3afa-4bf1-9acb-1b46751974e6', '9460a26c-9acc-4966-b5b4-8e232456228f', '075fb3b6-a0df-43be-b737-45592548d998', '273a5b81-5fbe-4f69-bf5b-a293846da06b'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Delete snapshot completed successfully. Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-390f00a3-e80b-49b7-bba5-c597d297f09a tempest-ProjectMemberTests-1897237629 None] Lock "cinder-b055b9b6-a2cd-461e-b701-898a09898a32-delete_snapshot" released by "delete_snapshot" :: held 3.572s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-fc3f42d0-7934-4485-9669-6a545c88495d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-fc3f42d0-7934-4485-9669-6a545c88495d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-fc3f42d0-7934-4485-9669-6a545c88495d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:24 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 1073741824" returned: 0 in 0.884s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-fc3f42d0-7934-4485-9669-6a545c88495d" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b260ca-5a87-4f42-aeb5-1f81207829a3]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:24 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 Jul 07 18:25:24 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:24 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d Jul 07 18:25:24 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:24 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1" returned: 0 in 0.691s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859ca370-6fab-4315-b663-f048175a4e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5709fe-68c8-40ca-8ac3-ec3d030a9fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:24 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Volume volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 (0d2c4cb1-517a-4ad2-a28d-21a044833be1): created successfully Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5709fe-68c8-40ca-8ac3-ec3d030a9fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Flow 'volume_create_manager' (14b5a495-ffc6-4a8c-8714-5dffe86389a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:24 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-851622d1-abf0-4823-91da-f44cff44f67a tempest-ProjectReaderTests-40729136 None] Created volume successfully. Jul 07 18:25:24 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:24 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d Jul 07 18:25:24 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Acquiring lock "cinder-0d2c4cb1-517a-4ad2-a28d-21a044833be1-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Lock "cinder-0d2c4cb1-517a-4ad2-a28d-21a044833be1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Acquiring lock "cinder-quobyte-0d2c4cb1-517a-4ad2-a28d-21a044833be1" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Lock "cinder-quobyte-0d2c4cb1-517a-4ad2-a28d-21a044833be1" acquired by "delete_volume" :: waited 0.013s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0273cf7-9609-4d85-8903-6bc7eaa210c6]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:25 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 Jul 07 18:25:25 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:25 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-fc3f42d0-7934-4485-9669-6a545c88495d" returned: 0 in 0.671s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-fc3f42d0-7934-4485-9669-6a545c88495d" released by "delete_volume" :: held 1.542s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Created reservations ['44b1963e-5e27-49a1-921a-85ce8ad5867e', 'ac90c0ed-448e-4199-b5f3-53ac8953ef5b', '3f660d02-58c6-483a-8ccd-da5c00396ea7', '2a4ef92a-d6a4-4e17-baf1-d760f99644ff'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:25 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:25 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:26 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1" returned: 0 in 0.844s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:26 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1 Jul 07 18:25:26 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:26 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.672s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:26 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Deleted volume successfully. Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-8af1cc8f-394f-4eb4-94ed-41b375928f1f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-fc3f42d0-7934-4485-9669-6a545c88495d-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (7e2a300e-0df8-44c2-9f42-c18f378f9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4633a65-1c44-4c8a-bd57-e809e328aa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4633a65-1c44-4c8a-bd57-e809e328aa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1358160273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7948061-c1c5-492a-9ea1-87edb9f48028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:27Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fc1dce-1108-48d7-93e2-c084e3d219ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45fc1dce-1108-48d7-93e2-c084e3d219ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423fee09-43d7-4cfa-b834-73e64f0e6cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423fee09-43d7-4cfa-b834-73e64f0e6cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7948061-c1c5-492a-9ea1-87edb9f48028', 'volume_name': 'volume-c7948061-c1c5-492a-9ea1-87edb9f48028', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9caf09-1e11-4e9c-bb89-36f349b104cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9caf09-1e11-4e9c-bb89-36f349b104cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b95555-8227-42ad-80b9-f9f9a9c0ede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:26 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Volume c7948061-c1c5-492a-9ea1-87edb9f48028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7948061-c1c5-492a-9ea1-87edb9f48028', 'volume_size': 1} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1358160273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7948061-c1c5-492a-9ea1-87edb9f48028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:27Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Creating volume c7948061-c1c5-492a-9ea1-87edb9f48028 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:26 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:26 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 1073741824 Jul 07 18:25:26 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:26 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-0d2c4cb1-517a-4ad2-a28d-21a044833be1" returned: 0 in 0.744s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Lock "cinder-quobyte-0d2c4cb1-517a-4ad2-a28d-21a044833be1" released by "delete_volume" :: held 1.630s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Created reservations ['80fee66e-1791-4459-ae1e-276fa1f70a6b', '8b00135c-4c85-4d8d-8998-bdb022c57f63', 'ae6ba7ca-ab27-4be4-b9dc-104a779aed6e', 'ca33d458-32b3-45d4-8d40-8989b18dfd8f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:27 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:27 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:27 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 1073741824" returned: 0 in 0.953s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:27 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.712s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Deleted volume successfully. Jul 07 18:25:27 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 Jul 07 18:25:27 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-26d2a7a9-9324-4f0f-b1c9-56e2157fd000 tempest-ProjectReaderTests-40729136 None] Lock "cinder-0d2c4cb1-517a-4ad2-a28d-21a044833be1-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Flow 'volume_create_manager' (2681e363-35ce-4589-8415-0cd3262577a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0c3b54-f9c3-4077-8e86-da4374696f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce0c3b54-f9c3-4077-8e86-da4374696f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682749949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2095a7b-7da9-469e-a3c2-5d128dd0f59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e9a8a0c58f4d2b9ff8c2d223de9c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:28Z,use_quota=True,user_id='7266bcd265dc4ee9bb95219a8cef3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b6759f-8b8b-4882-b261-808eaa7aa84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b6759f-8b8b-4882-b261-808eaa7aa84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15c0f3b-a35e-4397-942d-4dae5536b172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d15c0f3b-a35e-4397-942d-4dae5536b172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2095a7b-7da9-469e-a3c2-5d128dd0f59d', 'volume_name': 'volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d185fa3a-afd8-4f46-9d9f-accbbc1f213e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d185fa3a-afd8-4f46-9d9f-accbbc1f213e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09061b4c-0a17-4acc-ad33-12f1a890f792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:28 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Volume b2095a7b-7da9-469e-a3c2-5d128dd0f59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d', 'volume_size': 1} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:28 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028" returned: 0 in 0.664s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682749949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2095a7b-7da9-469e-a3c2-5d128dd0f59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e9a8a0c58f4d2b9ff8c2d223de9c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:28Z,use_quota=True,user_id='7266bcd265dc4ee9bb95219a8cef3394',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Creating volume b2095a7b-7da9-469e-a3c2-5d128dd0f59d {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:28 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:28 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d 1073741824 Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b95555-8227-42ad-80b9-f9f9a9c0ede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7948061-c1c5-492a-9ea1-87edb9f48028', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:28 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5684a645-91e2-4da7-a257-86d19c58f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:28 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Volume volume-c7948061-c1c5-492a-9ea1-87edb9f48028 (c7948061-c1c5-492a-9ea1-87edb9f48028): created successfully Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5684a645-91e2-4da7-a257-86d19c58f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:28 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (7e2a300e-0df8-44c2-9f42-c18f378f9eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:28 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-7269ea0c-e004-4474-b626-07c4d47f54f6 tempest-ProjectMemberTests-1897237629 None] Created volume successfully. Jul 07 18:25:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:29 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d 1073741824" returned: 0 in 0.841s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:29 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d Jul 07 18:25:29 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:30 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d" returned: 0 in 0.655s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.016s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Creating offline snapshot 6aa75002-605f-4c25-acdb-da782d994b0d of volume c7948061-c1c5-492a-9ea1-87edb9f48028 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09061b4c-0a17-4acc-ad33-12f1a890f792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1379c70c-2ead-4ccc-87bd-99f362ec4fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa36d08-0713-4e8f-96ec-583df2b1b21c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:30 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Volume volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d (b2095a7b-7da9-469e-a3c2-5d128dd0f59d): created successfully Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1379c70c-2ead-4ccc-87bd-99f362ec4fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Flow 'volume_create_manager' (2681e363-35ce-4589-8415-0cd3262577a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:30 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2e3bb74c-7b2b-430e-9409-00a377ac0b21 tempest-ProjectReaderTests-40729136 None] Created volume successfully. Jul 07 18:25:30 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 Jul 07 18:25:30 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:30 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028" returned: 0 in 0.799s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:30 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d 1G Jul 07 18:25:30 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Acquiring lock "cinder-b2095a7b-7da9-469e-a3c2-5d128dd0f59d-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Lock "cinder-b2095a7b-7da9-469e-a3c2-5d128dd0f59d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Acquiring lock "cinder-quobyte-b2095a7b-7da9-469e-a3c2-5d128dd0f59d" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:31 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Lock "cinder-quobyte-b2095a7b-7da9-469e-a3c2-5d128dd0f59d" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:31 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[825ff200-d542-4996-af7e-2ba722189b3d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:31 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d Jul 07 18:25:31 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:31 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d 1G" returned: 0 in 0.935s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7948061-c1c5-492a-9ea1-87edb9f48028 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:31 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7948061-c1c5-492a-9ea1-87edb9f48028 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d Jul 07 18:25:31 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:32 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d" returned: 0 in 0.845s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:32 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d Jul 07 18:25:32 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:32 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7948061-c1c5-492a-9ea1-87edb9f48028 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d" returned: 0 in 0.762s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:32 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d is being set with open permissions: ugo+rw Jul 07 18:25:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:32 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d Jul 07 18:25:32 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:32 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-b2095a7b-7da9-469e-a3c2-5d128dd0f59d" returned: 0 in 0.752s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:32 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Lock "cinder-quobyte-b2095a7b-7da9-469e-a3c2-5d128dd0f59d" released by "delete_volume" :: held 1.645s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Created reservations ['10a777e9-2c64-416e-b36a-da6d849c6364', 'bb95a369-1943-42b3-ad9f-f1857a09fa07', 'd67f23aa-6d95-469a-abd6-9277292e951e', '92a0f228-5e06-4e5a-bcc0-de6580c29784'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:33 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:33 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:33 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d" returned: 0 in 0.687s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:33 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.info Jul 07 18:25:33 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:33 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.739s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Deleted volume successfully. Jul 07 18:25:33 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-1b330bb6-34ad-44c2-a083-97e9237fcd28 tempest-ProjectReaderTests-40729136 None] Lock "cinder-b2095a7b-7da9-469e-a3c2-5d128dd0f59d-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:34 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.info" returned: 0 in 0.784s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:34 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.info is being set with open permissions: ugo+rw Jul 07 18:25:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:34 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.info Jul 07 18:25:34 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:34 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.info" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.756s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:34 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5bf4020c-9ed8-4751-911e-b59c86c7e371 tempest-ProjectMemberTests-1897237629 None] Create snapshot completed successfully Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-6aa75002-605f-4c25-acdb-da782d994b0d-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-6aa75002-605f-4c25-acdb-da782d994b0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-c7948061-c1c5-492a-9ea1-87edb9f48028" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-c7948061-c1c5-492a-9ea1-87edb9f48028" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-6aa75002-605f-4c25-acdb-da782d994b0d" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-6aa75002-605f-4c25-acdb-da782d994b0d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Deleting offline snapshot 6aa75002-605f-4c25-acdb-da782d994b0d of volume c7948061-c1c5-492a-9ea1-87edb9f48028 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] snapshot_file for this snap is: volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[822f70e2-d181-4390-8b5b-9271f3782f56]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:35 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d Jul 07 18:25:35 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:36 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d" returned: 0 in 0.842s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7948061-c1c5-492a-9ea1-87edb9f48028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:25:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d98ec1-6710-49ac-96dd-828f73c5642b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:36 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 Jul 07 18:25:36 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:37 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:37 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d Jul 07 18:25:37 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Flow 'volume_create_manager' (b77d6cd0-e154-4ad5-b7af-858b16003cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca93c17-1916-429f-a6c6-3a9f33d334e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca93c17-1916-429f-a6c6-3a9f33d334e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264321205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc55f84-a041-41af-805c-729da1770a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2888651937412db8c8150623f47105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:38Z,use_quota=True,user_id='40ac17a8f54e4632afd0b03b9cfdee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5805ca25-347b-4287-aeac-588445f2937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5805ca25-347b-4287-aeac-588445f2937f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ca6f0e-0021-47f7-9ea3-198a4f9b6164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ca6f0e-0021-47f7-9ea3-198a4f9b6164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc55f84-a041-41af-805c-729da1770a70', 'volume_name': 'volume-1dc55f84-a041-41af-805c-729da1770a70', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17aaa11d-bceb-40a5-80e2-39a18bfe6a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17aaa11d-bceb-40a5-80e2-39a18bfe6a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c247b673-b28d-4c6a-a77d-d8ab00b69239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:37 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Volume 1dc55f84-a041-41af-805c-729da1770a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc55f84-a041-41af-805c-729da1770a70', 'volume_size': 1} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264321205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc55f84-a041-41af-805c-729da1770a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2888651937412db8c8150623f47105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:38Z,use_quota=True,user_id='40ac17a8f54e4632afd0b03b9cfdee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Creating volume 1dc55f84-a041-41af-805c-729da1770a70 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:37 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:37 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70 1073741824 Jul 07 18:25:37 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:37 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d" returned: 0 in 0.763s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:37 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d Jul 07 18:25:37 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:38 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70 1073741824" returned: 0 in 0.824s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:38 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028.6aa75002-605f-4c25-acdb-da782d994b0d" returned: 0 in 0.674s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-6aa75002-605f-4c25-acdb-da782d994b0d" released by "_delete_snapshot" :: held 3.188s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-c7948061-c1c5-492a-9ea1-87edb9f48028" released by "delete_snapshot" :: held 3.219s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:38 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70 Jul 07 18:25:38 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:38 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Created reservations ['35e54cf7-af1e-490d-8b76-dca5c1eeae5e', '78c775b6-e83d-4cdb-b7f0-6d38d166c141', 'a6be74c5-5b9d-4e66-9aa2-96cb1e68d7aa', 'af5bbcf9-889f-4520-a8ca-9e1dcb95c30d'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:38 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Delete snapshot completed successfully. Jul 07 18:25:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a85561c2-e3ea-4093-8b9a-051fe7d9479f tempest-ProjectMemberTests-1897237629 None] Lock "cinder-6aa75002-605f-4c25-acdb-da782d994b0d-delete_snapshot" released by "delete_snapshot" :: held 3.360s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:39 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70" returned: 0 in 0.626s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c247b673-b28d-4c6a-a77d-d8ab00b69239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc55f84-a041-41af-805c-729da1770a70', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b79be3-0959-4f0d-b37e-59177516198f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:39 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Volume volume-1dc55f84-a041-41af-805c-729da1770a70 (1dc55f84-a041-41af-805c-729da1770a70): created successfully Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b79be3-0959-4f0d-b37e-59177516198f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Flow 'volume_create_manager' (b77d6cd0-e154-4ad5-b7af-858b16003cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:39 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-5bd4e459-5c4e-4f22-aaa0-b947c3f394d7 tempest-ProjectReaderTests-2127650920 None] Created volume successfully. Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-c7948061-c1c5-492a-9ea1-87edb9f48028-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-c7948061-c1c5-492a-9ea1-87edb9f48028-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-c7948061-c1c5-492a-9ea1-87edb9f48028" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-c7948061-c1c5-492a-9ea1-87edb9f48028" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc32e90-f25c-4c18-8fd2-312ba64699c3]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "cinder-1dc55f84-a041-41af-805c-729da1770a70-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-1dc55f84-a041-41af-805c-729da1770a70-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:39 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 Jul 07 18:25:39 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "cinder-quobyte-1dc55f84-a041-41af-805c-729da1770a70" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-quobyte-1dc55f84-a041-41af-805c-729da1770a70" acquired by "delete_volume" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a292eef-452e-4b6a-b48a-9a00bdff558a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:40 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70 Jul 07 18:25:40 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:40 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028" returned: 0 in 0.785s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:40 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028 Jul 07 18:25:40 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:40 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70" returned: 0 in 0.760s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:40 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70 Jul 07 18:25:40 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:41 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-c7948061-c1c5-492a-9ea1-87edb9f48028" returned: 0 in 0.655s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-c7948061-c1c5-492a-9ea1-87edb9f48028" released by "delete_volume" :: held 1.524s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Created reservations ['ce128c8e-f9ac-4756-b5fc-feccc0cb7273', '895588de-2ac7-457d-91dc-3a81e5df04ef', '277bb5dc-871b-4a19-855c-653d035b84b9', '2a2f30a5-bfa7-4af7-8deb-1447cf74ab48'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:41 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-1dc55f84-a041-41af-805c-729da1770a70" returned: 0 in 0.637s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-quobyte-1dc55f84-a041-41af-805c-729da1770a70" released by "delete_volume" :: held 1.458s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:41 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:41 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Created reservations ['7026eef8-a0eb-425c-801d-568e65821b3d', '9b3cb7d2-9bc9-4fb6-88c0-551b451661fc', 'd0a55b9a-f82b-469c-9b81-84e08829f631', 'd22dcbc1-08cc-413a-8ec0-dd16143a0bb0'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:41 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:41 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:42 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.683s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Deleted volume successfully. Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-40dc0bfd-9e4c-4520-bffd-17c756acb736 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-c7948061-c1c5-492a-9ea1-87edb9f48028-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:42 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.691s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Deleted volume successfully. Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edd605ba-1376-4206-a3a2-6fd5dff4c2f1 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-1dc55f84-a041-41af-805c-729da1770a70-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=167,cinder:SELECT=107,cinder:INSERT=38,cinder:DELETE=16 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (b6e63bed-cdab-4d73-9c54-c2ee8905fe8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d1b6c5-c243-48c7-948f-468d8c550059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d1b6c5-c243-48c7-948f-468d8c550059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-796770617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:42Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e8fea2-658b-4517-bf68-d26af8c12183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e8fea2-658b-4517-bf68-d26af8c12183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4885467-aa62-4cbd-a87d-4195f5bf0243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4885467-aa62-4cbd-a87d-4195f5bf0243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3', 'volume_name': 'volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80f2bbd-e908-49a5-a194-2f51199be692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80f2bbd-e908-49a5-a194-2f51199be692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926700e4-7ed6-4e4e-a69a-2b668da5d9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Volume 2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3', 'volume_size': 1} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-796770617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:42Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Creating volume 2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:42 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:42 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 1073741824 Jul 07 18:25:42 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Flow 'volume_create_manager' (2adb2efc-8b70-4b0b-9574-1cdae158caf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19a6da3-99d6-434a-a771-bd4fc5329e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19a6da3-99d6-434a-a771-bd4fc5329e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682568771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9baecd19-1631-44e4-9f01-c33b445d7d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2888651937412db8c8150623f47105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:43Z,use_quota=True,user_id='40ac17a8f54e4632afd0b03b9cfdee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c8dc1c-cbbe-4545-9238-6ce718315b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c8dc1c-cbbe-4545-9238-6ce718315b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5f4cfd-2dc9-4063-b3da-3b909fa115df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5f4cfd-2dc9-4063-b3da-3b909fa115df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9baecd19-1631-44e4-9f01-c33b445d7d7e', 'volume_name': 'volume-9baecd19-1631-44e4-9f01-c33b445d7d7e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ef53c7-0c57-4dae-8c5e-01742368e9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ef53c7-0c57-4dae-8c5e-01742368e9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bbdb55-3370-4659-adc7-16fed55dfe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:42 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Volume 9baecd19-1631-44e4-9f01-c33b445d7d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9baecd19-1631-44e4-9f01-c33b445d7d7e', 'volume_size': 1} Jul 07 18:25:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:43 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 1073741824" returned: 0 in 0.990s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:43 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 Jul 07 18:25:43 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:44 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" returned: 0 in 0.636s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-682568771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9baecd19-1631-44e4-9f01-c33b445d7d7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2888651937412db8c8150623f47105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:43Z,use_quota=True,user_id='40ac17a8f54e4632afd0b03b9cfdee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Creating volume 9baecd19-1631-44e4-9f01-c33b445d7d7e {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:44 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926700e4-7ed6-4e4e-a69a-2b668da5d9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:44 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e 1073741824 Jul 07 18:25:44 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a10052-a605-46d6-86e7-0083bfc10c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:44 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Volume volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 (2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3): created successfully Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a10052-a605-46d6-86e7-0083bfc10c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (b6e63bed-cdab-4d73-9c54-c2ee8905fe8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c016cb70-cf1b-4097-8499-1cd7e8fad666 tempest-ProjectMemberTests-1897237629 None] Created volume successfully. Jul 07 18:25:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:45 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e 1073741824" returned: 0 in 0.956s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:45 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e Jul 07 18:25:45 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:45 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e" returned: 0 in 0.665s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.154s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Creating offline snapshot e02cf8d4-bec0-486e-a0d0-944338479a88 of volume 2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bbdb55-3370-4659-adc7-16fed55dfe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9baecd19-1631-44e4-9f01-c33b445d7d7e', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c092a756-723f-4ef8-8ae4-0653a6e9ae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb58fb-3ec1-4b8a-b028-7441d3f24e0a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:45 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Volume volume-9baecd19-1631-44e4-9f01-c33b445d7d7e (9baecd19-1631-44e4-9f01-c33b445d7d7e): created successfully Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c092a756-723f-4ef8-8ae4-0653a6e9ae33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:45 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Flow 'volume_create_manager' (2adb2efc-8b70-4b0b-9574-1cdae158caf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:45 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-2fe49c32-b7f9-418f-9ae7-9101e644cce6 tempest-ProjectReaderTests-2127650920 None] Created volume successfully. Jul 07 18:25:45 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 Jul 07 18:25:45 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:46 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" returned: 0 in 0.775s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:46 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:46 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 1G Jul 07 18:25:46 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "cinder-9baecd19-1631-44e4-9f01-c33b445d7d7e-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:46 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-9baecd19-1631-44e4-9f01-c33b445d7d7e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "cinder-quobyte-9baecd19-1631-44e4-9f01-c33b445d7d7e" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:47 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-quobyte-9baecd19-1631-44e4-9f01-c33b445d7d7e" acquired by "delete_volume" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:47 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8a80bd-4fa5-4646-9f9d-69e7b8e23e5e]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:47 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e Jul 07 18:25:47 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:47 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 1G" returned: 0 in 0.843s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:47 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 Jul 07 18:25:47 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:47 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e" returned: 0 in 0.779s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:47 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:47 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e Jul 07 18:25:47 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:48 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88" returned: 0 in 0.719s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:48 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 is being set with open permissions: ugo+rw Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:48 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 Jul 07 18:25:48 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:48 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9baecd19-1631-44e4-9f01-c33b445d7d7e" returned: 0 in 0.674s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-quobyte-9baecd19-1631-44e4-9f01-c33b445d7d7e" released by "delete_volume" :: held 1.499s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Created reservations ['b5a6ddee-8b8f-48d2-a795-a07fbe1572ca', 'ddfac1d8-b146-4fb1-97d4-ec1ff72d8611', '5f13798f-035e-431a-b6a9-13a3660865a2', 'ca13a51a-8097-46e6-a164-6082d2a31010'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:48 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:48 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:48 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88" returned: 0 in 0.649s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:48 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:48 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.info Jul 07 18:25:48 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:49 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.684s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:49 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Deleted volume successfully. Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-924050f2-9a96-46ca-b42d-9f77d768dad5 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-9baecd19-1631-44e4-9f01-c33b445d7d7e-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:49 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.info" returned: 0 in 0.680s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:49 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.info is being set with open permissions: ugo+rw Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:49 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.info Jul 07 18:25:49 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Flow 'volume_create_manager' (a55b0ac0-9b3d-4ba6-af5f-50366a9ff9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e06428-7ee3-4135-841f-4f15551671b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e06428-7ee3-4135-841f-4f15551671b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528569506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a34c87d-b1e8-476d-b806-49c74f1e4966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2888651937412db8c8150623f47105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:50Z,use_quota=True,user_id='40ac17a8f54e4632afd0b03b9cfdee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac219436-18ab-42d8-bc16-9cf560459817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac219436-18ab-42d8-bc16-9cf560459817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe179aa-70a7-415f-812c-56f8a0d0a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe179aa-70a7-415f-812c-56f8a0d0a22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a34c87d-b1e8-476d-b806-49c74f1e4966', 'volume_name': 'volume-4a34c87d-b1e8-476d-b806-49c74f1e4966', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0365b39b-9d5d-4d48-a7c7-4f0872d345b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0365b39b-9d5d-4d48-a7c7-4f0872d345b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14007744-f2a3-47bc-af89-d0e2bd75d671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:49 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Volume 4a34c87d-b1e8-476d-b806-49c74f1e4966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a34c87d-b1e8-476d-b806-49c74f1e4966', 'volume_size': 1} Jul 07 18:25:49 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:50 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.info" returned: 0 in 0.648s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.402s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-528569506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a34c87d-b1e8-476d-b806-49c74f1e4966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2888651937412db8c8150623f47105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:50Z,use_quota=True,user_id='40ac17a8f54e4632afd0b03b9cfdee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Creating volume 4a34c87d-b1e8-476d-b806-49c74f1e4966 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:50 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:50 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 1073741824 Jul 07 18:25:50 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:50 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-d0d8a07c-27d8-4461-a0af-bd1f3471d28d tempest-ProjectMemberTests-1897237629 None] Create snapshot completed successfully Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-e02cf8d4-bec0-486e-a0d0-944338479a88-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-e02cf8d4-bec0-486e-a0d0-944338479a88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:50 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-e02cf8d4-bec0-486e-a0d0-944338479a88" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-e02cf8d4-bec0-486e-a0d0-944338479a88" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Deleting offline snapshot e02cf8d4-bec0-486e-a0d0-944338479a88 of volume 2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] snapshot_file for this snap is: volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dda678-1458-4ca0-96c0-d4186fb0cb81]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:51 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 1073741824" returned: 0 in 0.833s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:51 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 Jul 07 18:25:51 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:51 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 Jul 07 18:25:51 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:51 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966" returned: 0 in 0.683s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=148,cinder:SELECT=124,cinder:INSERT=43,cinder:DELETE=10 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14007744-f2a3-47bc-af89-d0e2bd75d671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a34c87d-b1e8-476d-b806-49c74f1e4966', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453245a0-3ab6-4245-801a-6f77eaa8ecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:51 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Volume volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 (4a34c87d-b1e8-476d-b806-49c74f1e4966): created successfully Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453245a0-3ab6-4245-801a-6f77eaa8ecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:51 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Flow 'volume_create_manager' (a55b0ac0-9b3d-4ba6-af5f-50366a9ff9fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88" returned: 0 in 0.836s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d105d64-2f4d-43d3-b1a5-1baea3c30726]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:51 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:51 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-503d95f5-521a-4ad7-bdf3-421e871d7177 tempest-ProjectReaderTests-2127650920 None] Created volume successfully. Jul 07 18:25:52 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 Jul 07 18:25:52 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:52 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" returned: 0 in 0.760s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:52 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:52 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 Jul 07 18:25:52 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "cinder-4a34c87d-b1e8-476d-b806-49c74f1e4966-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:52 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-4a34c87d-b1e8-476d-b806-49c74f1e4966-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "cinder-quobyte-4a34c87d-b1e8-476d-b806-49c74f1e4966" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:53 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-quobyte-4a34c87d-b1e8-476d-b806-49c74f1e4966" acquired by "delete_volume" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:53 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6495e4-5294-4515-93ea-c55bbd335f1a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:53 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 Jul 07 18:25:53 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:53 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88" returned: 0 in 0.807s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:53 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88 Jul 07 18:25:53 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:53 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966" returned: 0 in 0.804s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:53 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:53 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966 Jul 07 18:25:53 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:54 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3.e02cf8d4-bec0-486e-a0d0-944338479a88" returned: 0 in 0.717s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-e02cf8d4-bec0-486e-a0d0-944338479a88" released by "_delete_snapshot" :: held 3.233s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" released by "delete_snapshot" :: held 3.256s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Created reservations ['1ba069be-16d4-4371-8f11-cd5bf2bf9d88', 'dcf7099d-c1c4-4cd1-b50d-83bcacb3df05', '2b228692-f8e1-4328-b103-ec5f9f98199a', '6028a63b-a018-447e-9a1e-dfa92663f4cf'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:54 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Delete snapshot completed successfully. Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-9faa07dc-2cf0-4e39-9773-86601a67748c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-e02cf8d4-bec0-486e-a0d0-944338479a88-delete_snapshot" released by "delete_snapshot" :: held 3.403s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:54 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-4a34c87d-b1e8-476d-b806-49c74f1e4966" returned: 0 in 0.700s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-quobyte-4a34c87d-b1e8-476d-b806-49c74f1e4966" released by "delete_volume" :: held 1.548s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Created reservations ['bedf53db-03ef-4728-9f0d-379bb344d1d9', '971dc7e5-e097-45eb-bfd3-883946ee59d8', 'ce1dc0ce-7ef3-4f9a-a40c-bd71395b098f', 'a12dcd77-79e2-4810-ba49-e9895783fe93'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:54 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:54 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:54 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[97db06fe-8a79-4fbc-9bd5-ef388781a99f]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:55 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.768s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:55 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Deleted volume successfully. Jul 07 18:25:55 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 Jul 07 18:25:55 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-e6fae15c-1c76-4f45-b6f3-670cd5f86c53 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-4a34c87d-b1e8-476d-b806-49c74f1e4966-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Flow 'volume_create_manager' (66d67367-8eda-47db-92bf-40f05f1780db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efd4130-ff5b-4304-aa76-d011e9220479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efd4130-ff5b-4304-aa76-d011e9220479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615536953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56f4d45-557c-4709-a6d5-b17835492281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2888651937412db8c8150623f47105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:56Z,use_quota=True,user_id='40ac17a8f54e4632afd0b03b9cfdee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e9f14c-3b73-4e1c-8f3e-5da4646670b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e9f14c-3b73-4e1c-8f3e-5da4646670b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fd6c7d-a53d-4cf7-8b78-36e3716cc5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fd6c7d-a53d-4cf7-8b78-36e3716cc5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e56f4d45-557c-4709-a6d5-b17835492281', 'volume_name': 'volume-e56f4d45-557c-4709-a6d5-b17835492281', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accb90ed-a852-47ce-9afc-3ddd5a47566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accb90ed-a852-47ce-9afc-3ddd5a47566c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ae1aff-2537-402e-9456-1c73744edb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:55 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Volume e56f4d45-557c-4709-a6d5-b17835492281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e56f4d45-557c-4709-a6d5-b17835492281', 'volume_size': 1} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-615536953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e56f4d45-557c-4709-a6d5-b17835492281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce2888651937412db8c8150623f47105',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:56Z,use_quota=True,user_id='40ac17a8f54e4632afd0b03b9cfdee3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Creating volume e56f4d45-557c-4709-a6d5-b17835492281 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:55 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:55 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:55 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281 1073741824 Jul 07 18:25:55 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:56 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" returned: 0 in 0.838s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:56 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3 Jul 07 18:25:56 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:56 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281 1073741824" returned: 0 in 0.891s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:56 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281 Jul 07 18:25:56 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:56 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:56 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" returned: 0 in 0.669s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:56 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3" released by "delete_volume" :: held 1.582s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:56 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Created reservations ['4040464b-9341-4fe9-bcb9-84632f70f3e7', '67123ece-d83b-4a40-8267-9c65bea70815', '550ee14e-654a-4415-8100-a5a7195099cd', '20e5b9e2-5899-4fb4-a1c4-fd791d278deb'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:57 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:57 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:57 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281" returned: 0 in 0.744s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ae1aff-2537-402e-9456-1c73744edb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e56f4d45-557c-4709-a6d5-b17835492281', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ec3d7d-6d83-43ec-8b65-8e0b3f3cbf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:57 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Volume volume-e56f4d45-557c-4709-a6d5-b17835492281 (e56f4d45-557c-4709-a6d5-b17835492281): created successfully Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ec3d7d-6d83-43ec-8b65-8e0b3f3cbf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Flow 'volume_create_manager' (66d67367-8eda-47db-92bf-40f05f1780db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a43faea8-e149-4e0c-a6a0-95611546fabc tempest-ProjectReaderTests-2127650920 None] Created volume successfully. Jul 07 18:25:57 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.768s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:25:57 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Deleted volume successfully. Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-eeb3427b-ee34-4d2f-94c2-723ebaf7f24c tempest-ProjectMemberTests-1897237629 None] Lock "cinder-2e2e455e-4eb9-43fd-a6e2-b0fcb6f140c3-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "cinder-e56f4d45-557c-4709-a6d5-b17835492281-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-e56f4d45-557c-4709-a6d5-b17835492281-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:57 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "cinder-quobyte-e56f4d45-557c-4709-a6d5-b17835492281" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-quobyte-e56f4d45-557c-4709-a6d5-b17835492281" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c241f34-7fd6-4bd6-bf04-32f0ce75d3b6]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (24ca3f28-4ecc-4c10-ba62-5bdd7479d300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1b6347-dab9-4c2d-be7f-e93614e64a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1b6347-dab9-4c2d-be7f-e93614e64a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986845348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:58Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83633eee-3cd0-4815-af4d-48b8f3e8dead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83633eee-3cd0-4815-af4d-48b8f3e8dead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e977b4e0-09ad-4b3c-9c51-1619b58b3b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e977b4e0-09ad-4b3c-9c51-1619b58b3b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b', 'volume_name': 'volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d20bc9-64ed-498f-8214-bb5037d7c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d20bc9-64ed-498f-8214-bb5037d7c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad3d377-a340-44c3-b6a7-61f796d9bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:58 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Volume 6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b', 'volume_size': 1} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986845348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:25:58Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Creating volume 6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:25:58 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:58 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281 Jul 07 18:25:58 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:58 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b 1073741824 Jul 07 18:25:58 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:58 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281" returned: 0 in 0.801s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:58 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:58 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281 Jul 07 18:25:58 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:59 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b 1073741824" returned: 0 in 0.906s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:59 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b Jul 07 18:25:59 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:59 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-e56f4d45-557c-4709-a6d5-b17835492281" returned: 0 in 0.654s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-quobyte-e56f4d45-557c-4709-a6d5-b17835492281" released by "delete_volume" :: held 1.504s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Created reservations ['1b15ee0f-8274-4bfe-9176-6ae851903932', 'e550db9c-2eda-47bb-894e-c03b62ad2cc8', 'ab091904-3c0e-4ee4-90d9-148b2e47f963', '7bc406ec-e1eb-4e05-b8d7-f0112a43f85f'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:25:59 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:25:59 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:25:59 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" returned: 0 in 0.702s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad3d377-a340-44c3-b6a7-61f796d9bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cec974-752c-4402-871a-a1a8e7db8580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:25:59 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Volume volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b (6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b): created successfully Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80cec974-752c-4402-871a-a1a8e7db8580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:25:59 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (24ca3f28-4ecc-4c10-ba62-5bdd7479d300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:25:59 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-147cd2f1-ad17-4874-9272-5fd2326ec4f1 tempest-ProjectMemberTests-1897237629 None] Created volume successfully. Jul 07 18:26:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:00 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Creating offline snapshot f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 of volume 6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:26:00 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.683s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:00 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:26:00 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f63aeb8-5f70-4619-8a3d-1d832adb9b50]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:00 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:00 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Deleted volume successfully. Jul 07 18:26:00 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-68fd8e8d-010d-4ae3-a13a-e2a5551c17d0 tempest-ProjectReaderTests-2127650920 None] Lock "cinder-e56f4d45-557c-4709-a6d5-b17835492281-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:00 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b Jul 07 18:26:00 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:01 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" returned: 0 in 0.857s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:01 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:01 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 1G Jul 07 18:26:01 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:02 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 1G" returned: 0 in 1.013s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:02 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 Jul 07 18:26:02 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:02 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75" returned: 0 in 0.731s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:02 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 is being set with open permissions: ugo+rw Jul 07 18:26:02 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:02 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 Jul 07 18:26:02 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:03 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75" returned: 0 in 0.705s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:03 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:03 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.info Jul 07 18:26:03 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:04 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.info" returned: 0 in 0.680s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:04 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.info is being set with open permissions: ugo+rw Jul 07 18:26:04 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:04 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.info Jul 07 18:26:04 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:05 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.info" returned: 0 in 0.674s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.761s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:05 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-c0bd79eb-aa8d-4d00-b53c-6423d0c7f4c9 tempest-ProjectMemberTests-1897237629 None] Create snapshot completed successfully Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-f4b5cc9e-824d-41d6-adeb-e51c28e5ad75-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Lock "cinder-f4b5cc9e-824d-41d6-adeb-e51c28e5ad75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-f4b5cc9e-824d-41d6-adeb-e51c28e5ad75" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-f4b5cc9e-824d-41d6-adeb-e51c28e5ad75" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Deleting offline snapshot f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 of volume 6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] snapshot_file for this snap is: volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cde2f6-0f14-48e4-9689-2f6da593bc6c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:05 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:05 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 Jul 07 18:26:05 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:06 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75" returned: 0 in 0.756s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:06 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:26:06 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302f7f2-6df3-471b-a9ce-65ed6e27f7dd]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:06 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:06 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b Jul 07 18:26:06 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:07 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" returned: 0 in 0.726s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:07 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 Jul 07 18:26:07 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:07 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75" returned: 0 in 0.744s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:07 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:07 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75 Jul 07 18:26:07 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:08 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:08 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b.f4b5cc9e-824d-41d6-adeb-e51c28e5ad75" returned: 0 in 0.667s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-f4b5cc9e-824d-41d6-adeb-e51c28e5ad75" released by "_delete_snapshot" :: held 2.998s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" released by "delete_snapshot" :: held 3.029s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:08 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Created reservations ['d7e6ad55-a29d-40ce-84d5-4323e410e8c1', '312e64d8-e0dc-4c36-b64a-d9c38f403d83', '478cda7a-d896-4458-9e77-80f2f6c1cf11', '26710ecf-3392-4ef9-aa0f-b75c92416b71'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:26:08 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Delete snapshot completed successfully. Jul 07 18:26:08 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-edc439e3-3e2e-425f-910d-4c271d7de14e tempest-ProjectMemberTests-1897237629 None] Lock "cinder-f4b5cc9e-824d-41d6-adeb-e51c28e5ad75-delete_snapshot" released by "delete_snapshot" :: held 3.193s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:09 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:09 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c854a9c-e90a-44fd-8102-842d7bed2cae]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:09 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:10 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b Jul 07 18:26:10 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:10 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" returned: 0 in 0.798s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:10 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:10 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b Jul 07 18:26:10 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:11 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" returned: 0 in 0.654s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:11 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b" released by "delete_volume" :: held 1.509s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:11 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Created reservations ['9fce77ee-01b8-4dfc-bd70-ba8346a191b4', '07ea285a-909c-46ae-9790-e46245130be2', '913ae629-24c2-4635-9945-9d1f3a8874b3', '76942361-654f-4f64-923a-613edc445e06'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:26:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:26:11 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:26:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:11 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:11 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:26:11 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:12 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:26:12 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Deleted volume successfully. Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-ad80e5c4-4cc4-4d28-99b6-af3696f5a006 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-6cc3a4c2-da9c-4a83-8d5e-ae676388bc7b-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (47d1c60f-4752-47e3-9609-12d238cabad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3efd7b-0c2d-44c8-89f2-16b8b5317ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3efd7b-0c2d-44c8-89f2-16b8b5317ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224559996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4ea99b-aefe-4470-9cf5-d51a0aa30345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:26:12Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb03bbd-028f-41c5-9640-ac0c942d365b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb03bbd-028f-41c5-9640-ac0c942d365b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124f5fb1-2b05-4e9f-8f25-39ff9d42a200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124f5fb1-2b05-4e9f-8f25-39ff9d42a200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4ea99b-aefe-4470-9cf5-d51a0aa30345', 'volume_name': 'volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f1188e-ccaf-443f-9e95-e2add8dcaef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f1188e-ccaf-443f-9e95-e2add8dcaef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6114a0e9-5ead-40bc-b854-b7bd201c5316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:12 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Volume 7d4ea99b-aefe-4470-9cf5-d51a0aa30345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345', 'volume_size': 1} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-224559996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4ea99b-aefe-4470-9cf5-d51a0aa30345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:26:12Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Creating volume 7d4ea99b-aefe-4470-9cf5-d51a0aa30345 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:26:12 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:12 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 1073741824 Jul 07 18:26:12 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:26:12 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:26:13 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 1073741824" returned: 0 in 0.855s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:13 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 Jul 07 18:26:13 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:14 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" returned: 0 in 0.678s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6114a0e9-5ead-40bc-b854-b7bd201c5316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796571c6-055b-46aa-9ad6-73ace94bca34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:14 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Volume volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 (7d4ea99b-aefe-4470-9cf5-d51a0aa30345): created successfully Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796571c6-055b-46aa-9ad6-73ace94bca34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (47d1c60f-4752-47e3-9609-12d238cabad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:26:14 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-41eb2eb8-58f3-4974-a892-47e186ec450b tempest-ProjectMemberTests-1897237629 None] Created volume successfully. Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Creating offline snapshot 8713f061-4b3b-4a8c-b7c1-eafbca6ba379 of volume 7d4ea99b-aefe-4470-9cf5-d51a0aa30345 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[79031fd3-55a8-4463-bbf9-c3f323708989]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:14 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:14 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 Jul 07 18:26:14 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:15 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" returned: 0 in 0.754s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:15 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:15 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 1G Jul 07 18:26:15 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:16 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 1G" returned: 0 in 0.826s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:16 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:16 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 Jul 07 18:26:16 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:17 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379" returned: 0 in 0.772s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:17 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 is being set with open permissions: ugo+rw Jul 07 18:26:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:17 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 Jul 07 18:26:17 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:17 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379" returned: 0 in 0.698s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:17 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:17 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.info Jul 07 18:26:17 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:18 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.info" returned: 0 in 0.708s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:18 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.info is being set with open permissions: ugo+rw Jul 07 18:26:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:18 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.info Jul 07 18:26:18 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:19 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.info" returned: 0 in 0.678s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.522s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:19 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-b6c69786-1a32-408c-9a85-eeecc04998af tempest-ProjectMemberTests-1897237629 None] Create snapshot completed successfully Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-8713f061-4b3b-4a8c-b7c1-eafbca6ba379-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-8713f061-4b3b-4a8c-b7c1-eafbca6ba379-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-8713f061-4b3b-4a8c-b7c1-eafbca6ba379" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-8713f061-4b3b-4a8c-b7c1-eafbca6ba379" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Deleting offline snapshot 8713f061-4b3b-4a8c-b7c1-eafbca6ba379 of volume 7d4ea99b-aefe-4470-9cf5-d51a0aa30345 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] snapshot_file for this snap is: volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b867a01e-df44-4614-b701-655300f5cab4]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:20 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 Jul 07 18:26:20 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:21 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379" returned: 0 in 0.857s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:26:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fe27b5-341f-44c7-b054-841f91b9f28d]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:21 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 Jul 07 18:26:21 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:21 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" returned: 0 in 0.807s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:21 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 Jul 07 18:26:21 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:22 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379" returned: 0 in 0.757s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:22 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379 Jul 07 18:26:22 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:23 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345.8713f061-4b3b-4a8c-b7c1-eafbca6ba379" returned: 0 in 0.685s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-8713f061-4b3b-4a8c-b7c1-eafbca6ba379" released by "_delete_snapshot" :: held 3.198s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" released by "delete_snapshot" :: held 3.224s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:23 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Created reservations ['76beba6b-8bf9-4880-bea6-f92c71c84c36', 'c6c9b891-4a68-4e37-b58a-e776a143a057', '17839748-e090-4592-bc5a-18078c2e85a8', 'ebbac17e-0899-4973-93de-bd39faaf3520'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:26:23 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Delete snapshot completed successfully. Jul 07 18:26:23 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-cd5db3ec-09b5-446e-b97a-4919eb9a7ff8 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-8713f061-4b3b-4a8c-b7c1-eafbca6ba379-delete_snapshot" released by "delete_snapshot" :: held 3.392s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-7d4ea99b-aefe-4470-9cf5-d51a0aa30345-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-7d4ea99b-aefe-4470-9cf5-d51a0aa30345-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:24 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:24 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca45fb6e-3b41-4b83-b430-a7a33026ebd4]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:24 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 Jul 07 18:26:24 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:25 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" returned: 0 in 0.929s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:25 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345 Jul 07 18:26:25 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:26 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" returned: 0 in 0.750s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-7d4ea99b-aefe-4470-9cf5-d51a0aa30345" released by "delete_volume" :: held 1.749s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:26 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Created reservations ['00f5c8b4-9123-44a4-8513-d0e2ed896f0d', '579a01dd-19b1-4514-b880-96b8ad033bc4', '28b4e071-8967-4334-8921-8ce207e16f79', 'dea190fb-16b5-443c-94b2-9f4c3c7d5fbf'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:26:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:26:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:26:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:26 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:26:26 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:27 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.775s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:26:27 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Deleted volume successfully. Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-3541875d-f259-456a-a952-c7586dc710a4 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-7d4ea99b-aefe-4470-9cf5-d51a0aa30345-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (4b11a341-c85a-4bad-be6c-f325c767de3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3a4c30-0916-48c3-944f-a7b04bb12ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3a4c30-0916-48c3-944f-a7b04bb12ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1473364152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af10dcdc-4a94-48d3-8df6-dc4715ca1266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:26:27Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2653e1b4-5ee8-48d1-90a1-bd8288d1199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2653e1b4-5ee8-48d1-90a1-bd8288d1199a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a6e079-aad0-4447-8d32-69bd05125559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a6e079-aad0-4447-8d32-69bd05125559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af10dcdc-4a94-48d3-8df6-dc4715ca1266', 'volume_name': 'volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4583542-c2f9-4c17-b63f-b67a1060afc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4583542-c2f9-4c17-b63f-b67a1060afc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146f7bca-61fd-404a-83b7-1af794b9819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:27 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Volume af10dcdc-4a94-48d3-8df6-dc4715ca1266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266', 'volume_size': 1} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1473364152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af10dcdc-4a94-48d3-8df6-dc4715ca1266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32d639fea83e4c3c9282c229f2b1bcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:26:27Z,use_quota=True,user_id='13b93b67c3634348884c7c8ab19d492d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Creating volume af10dcdc-4a94-48d3-8df6-dc4715ca1266 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:26:27 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:26:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:27 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 1073741824 Jul 07 18:26:27 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:28 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 1073741824" returned: 0 in 0.953s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:28 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 Jul 07 18:26:28 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:28 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266" returned: 0 in 0.716s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:28 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:26:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146f7bca-61fd-404a-83b7-1af794b9819e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b4f69a-c291-427a-9f4c-fb858be69005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:26:29 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Volume volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 (af10dcdc-4a94-48d3-8df6-dc4715ca1266): created successfully Jul 07 18:26:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b4f69a-c291-427a-9f4c-fb858be69005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:26:29 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Flow 'volume_create_manager' (4b11a341-c85a-4bad-be6c-f325c767de3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:26:29 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-3752ef2c-fdb1-48fc-90e2-7a47e6a98248 tempest-ProjectMemberTests-1897237629 None] Created volume successfully. Jul 07 18:26:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:29 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Creating offline snapshot 5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 of volume af10dcdc-4a94-48d3-8df6-dc4715ca1266 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:26:29 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c3cd50-16ef-4e9a-8db6-e47923f231ce]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:29 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:29 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 Jul 07 18:26:29 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:30 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266" returned: 0 in 0.862s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:30 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:30 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 1G Jul 07 18:26:30 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:31 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 1G" returned: 0 in 0.885s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:31 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 Jul 07 18:26:31 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:31 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16" returned: 0 in 0.707s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:31 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 is being set with open permissions: ugo+rw Jul 07 18:26:31 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:31 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 Jul 07 18:26:31 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:32 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16" returned: 0 in 0.654s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:32 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.info Jul 07 18:26:32 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:33 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.info" returned: 0 in 0.663s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:33 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.info is being set with open permissions: ugo+rw Jul 07 18:26:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:33 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.info Jul 07 18:26:33 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:33 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.info" returned: 0 in 0.668s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.524s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:33 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-afcb6bdd-8a7f-4bdb-ab33-fcd60314f2c0 tempest-ProjectMemberTests-1897237629 None] Create snapshot completed successfully Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-af10dcdc-4a94-48d3-8df6-dc4715ca1266" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-af10dcdc-4a94-48d3-8df6-dc4715ca1266" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Deleting offline snapshot 5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 of volume af10dcdc-4a94-48d3-8df6-dc4715ca1266 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] snapshot_file for this snap is: volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35338de-0e23-4bc0-8caa-114800c7d105]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:34 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 Jul 07 18:26:34 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:35 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16" returned: 0 in 0.792s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:26:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[8922de16-798a-4c43-b21d-ce663e092a3a]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:35 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 Jul 07 18:26:35 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:36 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266" returned: 0 in 0.824s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:36 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 Jul 07 18:26:36 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:37 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16" returned: 0 in 0.709s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:37 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16 Jul 07 18:26:37 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:37 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266.5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16" returned: 0 in 0.629s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16" released by "_delete_snapshot" :: held 3.050s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:37 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-af10dcdc-4a94-48d3-8df6-dc4715ca1266" released by "delete_snapshot" :: held 3.077s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:37 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Created reservations ['418f6d58-1f8f-4eef-a682-def9c72ebc2e', 'c6a9f5ef-05bc-4f69-98a3-e87cec6f6993', 'd6790243-5b3b-43f6-b4c5-ab4055754202', '2cd41c49-50c4-43f0-b549-876df47f3086'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:26:38 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Delete snapshot completed successfully. Jul 07 18:26:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-64c039a7-e97d-4f6a-ba46-c3bab4d58981 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-5136e5ca-d9ca-4b8f-92ee-a33e9e0d1e16-delete_snapshot" released by "delete_snapshot" :: held 3.233s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-af10dcdc-4a94-48d3-8df6-dc4715ca1266-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-af10dcdc-4a94-48d3-8df6-dc4715ca1266-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "cinder-quobyte-af10dcdc-4a94-48d3-8df6-dc4715ca1266" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:26:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-af10dcdc-4a94-48d3-8df6-dc4715ca1266" acquired by "delete_volume" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:26:39 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72e23b7-a8a5-4b43-969d-4a3e60c3e49c]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:26:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:39 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 Jul 07 18:26:39 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:39 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266" returned: 0 in 0.855s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:40 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266 Jul 07 18:26:40 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:40 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-af10dcdc-4a94-48d3-8df6-dc4715ca1266" returned: 0 in 0.750s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-quobyte-af10dcdc-4a94-48d3-8df6-dc4715ca1266" released by "delete_volume" :: held 1.662s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Created reservations ['bfd59e13-ec4c-4ad9-b78d-ac34eaa0b12c', '329df6b1-0339-4f44-be8e-77d4f5abfade', 'eadd08b3-9b27-4905-a625-72e8dec2b0b1', 'b8f3e08e-899c-4a23-a7d0-7db30d3077c7'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:26:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:26:40 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:26:40 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:26:41 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 07 18:26:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.699s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:26:41 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:26:41 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Deleted volume successfully. Jul 07 18:26:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-6a96fe7a-714a-45d3-bf66-53f91d290a64 tempest-ProjectMemberTests-1897237629 None] Lock "cinder-af10dcdc-4a94-48d3-8df6-dc4715ca1266-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:26:50 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:UPDATE=111,cinder:SELECT=81,cinder:INSERT=28,cinder:DELETE=6 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:26:51 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:DELETE=10,cinder:UPDATE=83,cinder:SELECT=57,cinder:INSERT=25 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:27:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:27:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:27:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:27:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:27:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:27:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:27:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:12 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:27:12 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:13 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.779s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:27:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:27:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:27:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Flow 'volume_create_manager' (4c2bd6d3-f3e9-4c85-ac4f-c878ca9b12fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b75bc95-b69d-4228-a3ec-968ba929349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b75bc95-b69d-4228-a3ec-968ba929349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1697222654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6bad45-9cae-4533-b69b-e89ab3f737d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f736a5f0c1c3425082629533e1e18c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:27:19Z,use_quota=True,user_id='0ab398ace95e4cd09bca9ac9ec636a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84367a2a-57dd-4a11-9722-3f0e5f0eb41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84367a2a-57dd-4a11-9722-3f0e5f0eb41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6af2e9-00bb-4d3e-9e67-74fcb6446a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6af2e9-00bb-4d3e-9e67-74fcb6446a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6bad45-9cae-4533-b69b-e89ab3f737d5', 'volume_name': 'volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2f3a91-95a1-4f82-a6df-a8f9c4f0099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2f3a91-95a1-4f82-a6df-a8f9c4f0099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f00cab-0ab2-40ca-82a1-20d86adfc20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:18 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Volume 9c6bad45-9cae-4533-b69b-e89ab3f737d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5', 'volume_size': 1} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1697222654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6bad45-9cae-4533-b69b-e89ab3f737d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f736a5f0c1c3425082629533e1e18c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:27:19Z,use_quota=True,user_id='0ab398ace95e4cd09bca9ac9ec636a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)}" {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Creating volume 9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:27:18 devstack cinder-volume[86972]: INFO cinder.volume.drivers.remotefs [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] casted to osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 Jul 07 18:27:18 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 1073741824 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:18 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 1073741824 Jul 07 18:27:18 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:19 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 1073741824" returned: 0 in 0.886s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:19 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:19 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 Jul 07 18:27:19 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:20 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5" returned: 0 in 0.643s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:20 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'} {{(pid=86972) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 18:27:20 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:27:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f00cab-0ab2-40ca-82a1-20d86adfc20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5', 'volume_size': 1}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258ed882-215e-4081-9cae-61482707f92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:20 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Volume volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 (9c6bad45-9cae-4533-b69b-e89ab3f737d5): created successfully Jul 07 18:27:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258ed882-215e-4081-9cae-61482707f92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:20 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Flow 'volume_create_manager' (4c2bd6d3-f3e9-4c85-ac4f-c878ca9b12fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:27:20 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-e17de4ae-6700-4b4c-8207-9e0fb18341da tempest-SnapshotDependencyTests-677954605 None] Created volume successfully. Jul 07 18:27:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:27:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:27:21 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Creating offline snapshot bec4c87a-14f9-45b2-8638-a82d59c2090d of volume 9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 18:27:21 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5482d0-c13e-4c75-a561-ca8fdd2efd69]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:27:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:21 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 Jul 07 18:27:21 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:21 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5" returned: 0 in 0.780s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:21 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d 1G {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:21 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d 1G Jul 07 18:27:21 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:22 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d 1G" returned: 0 in 0.817s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:22 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:22 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d Jul 07 18:27:22 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:23 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 -F qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d" returned: 0 in 0.768s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:23 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d is being set with open permissions: ugo+rw Jul 07 18:27:23 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:23 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d Jul 07 18:27:23 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:24 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d" returned: 0 in 0.627s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:24 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.info Jul 07 18:27:24 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:24 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.info" returned: 0 in 0.643s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:24 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.info is being set with open permissions: ugo+rw Jul 07 18:27:24 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.info {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:24 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.info Jul 07 18:27:24 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:25 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.info" returned: 0 in 0.636s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:25 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.368s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:27:25 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dcba74ef-3e33-4072-8cc9-e7e2155e4245 tempest-SnapshotDependencyTests-677954605 None] Create snapshot completed successfully Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.flows.manager.create_volume [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86972) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Flow 'volume_create_manager' (26bfc480-d6b7-4a1b-8101-2085ec730e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc019bc-9133-4a90-81ad-39255a8a1a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc019bc-9133-4a90-81ad-39255a8a1a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T16:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade8edd5-92a8-406f-a663-f86f59162f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f736a5f0c1c3425082629533e1e18c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T16:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bec4c87a-14f9-45b2-8638-a82d59c2090d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T16:27:27Z,use_quota=True,user_id='0ab398ace95e4cd09bca9ac9ec636a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fdbdd75-9088-49e0-83aa-348f8a7c7f56),volume_type_id=3fdbdd75-9088-49e0-83aa-348f8a7c7f56)' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd47a07f-7134-4c98-b6f1-a6883dcde5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd47a07f-7134-4c98-b6f1-a6883dcde5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57104dd2-df08-42aa-8171-48886eb19613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57104dd2-df08-42aa-8171-48886eb19613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ade8edd5-92a8-406f-a663-f86f59162f9c', 'volume_name': 'volume-ade8edd5-92a8-406f-a663-f86f59162f9c', 'volume_size': 1, 'snapshot_id': 'bec4c87a-14f9-45b2-8638-a82d59c2090d'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42a4d3f-90dd-408f-b08e-c50460499f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42a4d3f-90dd-408f-b08e-c50460499f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5db6d2-eb34-48e9-8075-462f9faf2c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:26 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Volume ade8edd5-92a8-406f-a663-f86f59162f9c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ade8edd5-92a8-406f-a663-f86f59162f9c', 'volume_size': 1, 'snapshot_id': 'bec4c87a-14f9-45b2-8638-a82d59c2090d'} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "cinder-quobyte-bec4c87a-14f9-45b2-8638-a82d59c2090d-ade8edd5-92a8-406f-a663-f86f59162f9c" by "_create_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-bec4c87a-14f9-45b2-8638-a82d59c2090d-ade8edd5-92a8-406f-a663-f86f59162f9c" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Creating volume ade8edd5-92a8-406f-a663-f86f59162f9c from snapshot bec4c87a-14f9-45b2-8638-a82d59c2090d {{(pid=86972) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Selected osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260 as target Quobyte volume. {{(pid=86972) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "cinder-quobyte-ade8edd5-92a8-406f-a663-f86f59162f9c" by "_copy_volume_from_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-ade8edd5-92a8-406f-a663-f86f59162f9c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] snapshot: bec4c87a-14f9-45b2-8638-a82d59c2090d, volume: ade8edd5-92a8-406f-a663-f86f59162f9c, {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:27:26 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:27:27 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d6114b-20c8-47b9-942d-5cb769357efc]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:27:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:27 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d Jul 07 18:27:27 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:27 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d" returned: 0 in 0.757s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:27:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 18:27:27 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Creating direct copy from snapshot {{(pid=86972) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 18:27:27 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1a6e3-8019-4a9e-84a3-f278bd852ca9]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:27:27 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:27 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 Jul 07 18:27:27 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:28 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5" returned: 0 in 0.754s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:28 devstack cinder-volume[86972]: DEBUG cinder.utils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Path /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c not found in is_blk_device check {{(pid=86972) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 18:27:28 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:28 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c Jul 07 18:27:28 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:32 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c" returned: 0 in 4.332s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:32 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e57eca-ada7-4493-ab0b-ad26568b2015]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:27:32 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:32 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 Jul 07 18:27:32 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:33 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5" returned: 0 in 0.894s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:33 devstack cinder-volume[86972]: DEBUG cinder.image.image_utils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Image conversion details: src /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c {{(pid=86972) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 18:27:33 devstack cinder-volume[86972]: INFO cinder.image.image_utils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Converted 1024.00 MB image at 236.30 MB/s Jul 07 18:27:33 devstack cinder-volume[86972]: WARNING cinder.volume.drivers.remotefs [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c is being set with open permissions: ugo+rw Jul 07 18:27:33 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:33 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c Jul 07 18:27:33 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:34 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c" returned: 0 in 0.699s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-ade8edd5-92a8-406f-a663-f86f59162f9c" released by "_copy_volume_from_snapshot" :: held 7.525s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:27:34 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-bec4c87a-14f9-45b2-8638-a82d59c2090d-ade8edd5-92a8-406f-a663-f86f59162f9c" released by "_create_volume_from_snapshot" :: held 7.554s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:27:34 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.567s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:27:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac5db6d2-eb34-48e9-8075-462f9faf2c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade8edd5-92a8-406f-a663-f86f59162f9c', 'volume_size': 1, 'snapshot_id': 'bec4c87a-14f9-45b2-8638-a82d59c2090d'}' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f60314-ea01-492a-a4c0-8713bb6ced68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 18:27:34 devstack cinder-volume[86972]: INFO cinder.volume.flows.manager.create_volume [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Volume volume-ade8edd5-92a8-406f-a663-f86f59162f9c (ade8edd5-92a8-406f-a663-f86f59162f9c): created successfully Jul 07 18:27:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47f60314-ea01-492a-a4c0-8713bb6ced68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86972) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 18:27:34 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Flow 'volume_create_manager' (26bfc480-d6b7-4a1b-8101-2085ec730e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86972) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 18:27:34 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-58f4c2c7-03af-4df9-a2cc-0cd7d827387a tempest-SnapshotDependencyTests-677954605 None] Created volume successfully. Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "cinder-bec4c87a-14f9-45b2-8638-a82d59c2090d-delete_snapshot" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-bec4c87a-14f9-45b2-8638-a82d59c2090d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "cinder-quobyte-9c6bad45-9cae-4533-b69b-e89ab3f737d5" by "delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-9c6bad45-9cae-4533-b69b-e89ab3f737d5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "cinder-quobyte-bec4c87a-14f9-45b2-8638-a82d59c2090d" by "_delete_snapshot" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-bec4c87a-14f9-45b2-8638-a82d59c2090d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Deleting offline snapshot bec4c87a-14f9-45b2-8638-a82d59c2090d of volume 9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] snapshot_file for this snap is: volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d {{(pid=86972) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2db27f-e8b8-4e35-8008-409da730b165]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:27:35 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:35 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d Jul 07 18:27:35 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:36 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d" returned: 0 in 0.786s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:36 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.remotefs [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86972) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 18:27:36 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aacdb4-36c2-4fdf-8563-a69c89702696]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:27:36 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:36 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 Jul 07 18:27:36 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:37 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5" returned: 0 in 0.741s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:37 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d Jul 07 18:27:37 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:37 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d" returned: 0 in 0.732s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:37 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:37 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d Jul 07 18:27:37 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:38 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:38 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5.bec4c87a-14f9-45b2-8638-a82d59c2090d" returned: 0 in 0.694s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-bec4c87a-14f9-45b2-8638-a82d59c2090d" released by "_delete_snapshot" :: held 3.056s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:27:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-9c6bad45-9cae-4533-b69b-e89ab3f737d5" released by "delete_snapshot" :: held 3.080s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:27:38 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Created reservations ['bc1bec83-cfbb-48c1-8825-ed25884d7dcc', '1c88b1df-1c91-49f5-a831-6312f3be6784', 'a56535d9-493f-47de-9149-d49c14c44413', 'd01e8286-2203-4cad-94c6-cd6c65ba3258'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:27:38 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Delete snapshot completed successfully. Jul 07 18:27:38 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-a068c05a-ceb6-4e72-8227-939932c04229 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-bec4c87a-14f9-45b2-8638-a82d59c2090d-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:27:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "cinder-9c6bad45-9cae-4533-b69b-e89ab3f737d5-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:27:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-9c6bad45-9cae-4533-b69b-e89ab3f737d5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:27:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "cinder-quobyte-9c6bad45-9cae-4533-b69b-e89ab3f737d5" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:27:39 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-9c6bad45-9cae-4533-b69b-e89ab3f737d5" acquired by "delete_volume" :: waited 0.017s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:27:39 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c545b2-3ce7-4324-882f-91a18f076fa0]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:27:39 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:40 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 Jul 07 18:27:40 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:40 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5" returned: 0 in 0.822s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:40 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:40 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5 Jul 07 18:27:40 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:41 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-9c6bad45-9cae-4533-b69b-e89ab3f737d5" returned: 0 in 0.667s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:41 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-9c6bad45-9cae-4533-b69b-e89ab3f737d5" released by "delete_volume" :: held 1.551s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:27:41 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Created reservations ['c5d13bec-7966-402f-bfd9-de185a53c54e', '495630ef-9655-41c9-bc31-d69ecb64607f', 'c9621f07-1a46-441d-a8d4-0c6999290b09', 'd1005606-56fe-4b78-84ba-c1df7fdc8070'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:27:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:27:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:27:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:27:41 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:27:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:27:41 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:41 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:27:41 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "cinder-ade8edd5-92a8-406f-a663-f86f59162f9c-delete_volume" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-ade8edd5-92a8-406f-a663-f86f59162f9c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "cinder-quobyte-ade8edd5-92a8-406f-a663-f86f59162f9c" by "delete_volume" {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-ade8edd5-92a8-406f-a663-f86f59162f9c" acquired by "delete_volume" :: waited 0.014s {{(pid=86972) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2cd9ae-5cda-41bc-9c4e-e462b415629b]: (4, 'qcow2') {{(pid=88280) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:42 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.689s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:27:42 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Deleted volume successfully. Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-dc6e9420-f169-4444-a6ee-7e7b8c18ae6a tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-9c6bad45-9cae-4533-b69b-e89ab3f737d5-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:27:42 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c Jul 07 18:27:42 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:42 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c" returned: 0 in 0.783s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:42 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:42 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c Jul 07 18:27:42 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:43 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb/volume-ade8edd5-92a8-406f-a663-f86f59162f9c" returned: 0 in 0.645s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:43 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-quobyte-ade8edd5-92a8-406f-a663-f86f59162f9c" released by "delete_volume" :: held 1.474s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:27:43 devstack cinder-volume[86972]: DEBUG cinder.quota [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Created reservations ['77062181-b5cf-4e27-add2-e58db7eb18db', '9df46c26-a34b-452d-8bd8-ba3f7b0a0e31', 'f77c5d50-a044-44be-951b-44b8c4a04ee1', 'dc38a4e8-d930-4abf-8d6e-bd69d7ffefa1'] {{(pid=86972) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 18:27:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:27:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:27:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:27:43 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:27:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:27:43 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:27:43 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:27:43 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:27:44 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 07 18:27:44 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.636s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:27:44 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:27:44 devstack cinder-volume[86972]: INFO cinder.volume.manager [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Deleted volume successfully. Jul 07 18:27:44 devstack cinder-volume[86972]: DEBUG cinder.coordination [None req-0b403915-7dc1-4ae2-97de-43a552dbf975 tempest-SnapshotDependencyTests-677954605 None] Lock "cinder-ade8edd5-92a8-406f-a663-f86f59162f9c-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=86972) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 18:27:53 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=24,cinder:UPDATE=31,cinder:INSERT=10 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:28:01 devstack cinder-volume[86972]: DEBUG dbcounter [-] [86972] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:DELETE=5,cinder:INSERT=4 {{(pid=86972) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 18:28:12 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:28:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 18:28:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 18:28:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260': None} {{(pid=86972) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 18:28:12 devstack cinder-volume[86972]: DEBUG cinder.volume.drivers.quobyte [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-269c2ed3-7210-4f0f-8343-1044c691f260'] {{(pid=86972) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 18:28:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.lockutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86972) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 18:28:12 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 18:28:12 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb Jul 07 18:28:12 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 18:28:13 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 07 18:28:13 devstack cinder-volume[86972]: DEBUG oslo_concurrency.processutils [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0e8c31569a8e6a066fb30df8cafe1abb" returned: 0 in 0.658s {{(pid=86972) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 18:28:13 devstack cinder-volume[86972]: DEBUG cinder.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Notifying Schedulers of capabilities ... {{(pid=86972) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 18:28:13 devstack cinder-volume[86972]: DEBUG oslo_service.periodic_task [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] Running periodic task VolumeManager._thread_info {{(pid=86972) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 18:28:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread count: 28 {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 07 18:28:13 devstack cinder-volume[86972]: DEBUG cinder.volume.manager [None req-c9bdc45e-a9ec-470e-b1eb-4fb758e57638 None None] thread info: [<_MainThread(MainThread, started 138757742792832)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86972) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}